Magnifying observation apparatus

ABSTRACT

An emitting section of a light projecting section is provided to surround an optical axis of an objective lens of a lens unit. The optical axis of the emitting section is substantially the same as the optical axis of the objective lens. Ring illumination is irradiated on the observation target from the emitting section and light from the observation target is received by an imaging section via the objective lens, whereby first original image data is generated. Directional illumination is irradiated on the observation target from the emitting section and the light from the observation target is received by the imaging section via the objective lens, whereby second original image data is generated. Image data for display indicating an image of the observation target that should be obtained when it is assumed that light in a specific emitting direction is irradiated on the observation target is generated.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims foreign priority based on Japanese PatentApplication No. 2016-144934, filed Jul. 22, 2016, the contents of whichis incorporated herein by reference.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a magnifying observation apparatus formagnifying and observing an observation target.

2. Description of Related Art

A magnifying observation apparatus is sometimes used in order to magnifyand observe an observation target (see, for example, JP-A-2013-72971).In the microscope system described in JP-A-2013-72971, bright-fieldillumination light and dark-field illumination light are irradiated on asample on a stage through an objective lens.

The bright-field illumination light is illumination light emitted in adirection parallel to an optical axis of the objective lens. Thedark-field illumination light is illumination light emitted in adirection inclined with respect to the optical axis of the objectivelens. Observation light reflected on the sample is made incident on animaging apparatus through an imaging lens, whereby the sample is imaged.

In the microscope system described in JP-A-2013-72971, illuminationintensity of one illumination light is relatively reduced according to aratio of an exposure time for the bright-field illumination light and anexposure time for the dark-field illumination light. Consequently, theintensity of the bright-field illumination light and the intensity ofthe dark-field illumination light are aligned. JP-A-2013-72971 mentionsthat, as a result, in observing a sample on which the bright-fieldillumination light and the dark-field illumination light aresimultaneously irradiated, it is possible to perform the observation ofthe sample at most suitable illumination intensity. A user is capable ofintuitively adjusting a ratio of illumination intensities of thebright-field illumination light and the dark-field illumination lightfrom an image in an optimized illumination intensity state.

However, appropriate imaging conditions such as illumination intensityare different depending on the shape and the material of an observationtarget. Therefore, it is difficult for an unskilled user to acquire animage captured under the appropriate imaging conditions. It is sometimesfound ex post that the imaging conditions are inappropriate. In such acase, imaging of the observation target needs to be performed againunder different imaging conditions. Therefore, a burden on the userincreases.

SUMMARY OF THE INVENTION

An object of the present invention is to provide a magnifyingobservation apparatus capable of easily acquiring an image of anobservation target corresponding to a request of a user.

(1) A magnifying observation apparatus according to a first inventionincludes: a stage including a placement surface on which an observationtarget is placed; a lens unit including an objective lens; a lightprojecting unit including an emitting section having an optical axissubstantially same as an optical axis of the objective lens and providedto surround the optical axis of the objective lens, the light projectingunit selectively irradiating, on the observation target placed on thestage, light in a first emitting direction and light in a secondemitting direction different from the first emitting direction; animaging section configured to receive light from the observation targetvia the objective lens and generate first or second original image dataindicating an image of the observation target; and a data generatingsection configured to generate image data for display indicating animage of the observation target that should be obtained when it isassumed that light in a specific emitting direction designated by a useris irradiated on the observation target. At a first light irradiationtime, the light projecting unit irradiates the light in the firstemitting direction on the observation target and the imaging sectiongenerates the first original image data. At a second light irradiationtime, the light projecting unit irradiates the light in the secondemitting direction on the observation target and the imaging sectiongenerates the second original image data. The data generating sectiongenerates the image data for display on the basis of at least one of thefirst and second original image data.

In the magnifying observation apparatus, the observation target isplaced on the placement surface of the stage. The emitting section ofthe light projecting unit is provided to surround the optical axis ofthe objective lens of the lens unit. The optical axis of the emittingsection is substantially the same as the optical axis of the objectivelens. The light in the first emitting direction is irradiated on theobservation target from the emitting section and the light from theobservation target is received by the imaging section via the objectivelens, whereby the first original image data indicating the image of theobservation target is generated. The light in the second emittingdirection different from the first emitting direction is irradiated onthe observation target from the emitting section and the light from theobservation target is received by the imaging section via the objectivelens, whereby the second original image data indicating the image of theobservation target is generated. Further, the image data for displayindicating the image of the observation target that should be obtainedwhen it is assumed that the light in the specific emitting directiondesignated by the user is irradiated on the observation target isgenerated by the data generating section on the basis of at least one ofthe first and second original image data.

With this configuration, the emitting section of the light projectingunit surrounds the optical axis of the objective lens and the opticalaxis of the emitting section is substantially the same as the opticalaxis of the objective lens. Therefore, the light projecting unit iscapable of irradiating at least light in a uniform emitting direction onthe observation target. The light projecting unit is capable ofirradiating light in an emitting direction different from the emittingdirection on the observation target. Therefore, the user can generate,by optionally designating an emitting direction, without changing anemitting direction of light actually irradiated on the observationtarget, image data for display indicating an image at the time whenlight in an appropriate emitting direction corresponding to the shapeand the material of the observation target is irradiated on theobservation target. Consequently, the user can easily acquire an imageof the observation target corresponding to a request of the user.

The image data for display can be generated using the already generatedfirst and second original image data. Therefore, it is unnecessary toperform imaging of the observation target again. Therefore, it ispossible to reduce a burden on the user.

(2) The emitting section of the light projecting unit may include aplurality of light emission regions disposed rotation-symmetricallyaround the optical axis of the objective lens and simultaneously emitlights from the plurality of light emission regions at the first lightirradiation time to thereby irradiate the light in the first emittingdirection on the observation target.

In this case, the light projecting unit can easily emit the light in theuniform emitting direction from the plurality of light emission regionsas the light in the first emitting direction. When the image data fordisplay is generated by an arithmetic operation on the basis of thefirst and second original image data, the arithmetic operation can besimplified.

(3) At the second light irradiation time, the emitting section of thelight projecting unit may emit light from a part of the plurality oflight emission regions to thereby irradiate the light in the secondemitting direction on the observation target. In this case, the lightprojecting unit can easily emit the light in the second emittingdirection different from the first emitting direction from the part ofthe plurality of light emission regions.

(4) At the second light irradiation time, the emitting section of thelight projecting unit may sequentially emit light from each of theplurality of light emission regions, and the imaging section maysequentially generate a plurality of the second original image datarespectively corresponding to the plurality of light emission regions.

In this case, the light projecting unit sequentially emits lights in aplurality of emitting directions different from one another. Therefore,the observation target is imaged under a plurality of imaging conditionsdifferent from one another. Forms of a plurality of images respectivelyindicated by the generated plurality of second original image data aredifferent from one another. Consequently, it is possible to easilygenerate the image data for display on the basis of the first originalimage data and at least one of the plurality of second original imagedata.

(5) The plurality of light emission regions may be located on acircumference centering on the optical axis of the objective lens. Inthis case, the light projecting unit can easily emit lights in a moreuniform emitting direction from the plurality of light emission regionsas the light in the first emitting direction. When the image data fordisplay is generated by an arithmetic operation on the basis of thefirst and second original image data, the arithmetic operation can befurther simplified.

(6) One or more light emitting members may be provided in each of theplurality of light emission regions. In this case, the light projectingunit can easily emit light from each of the plurality of light emissionregions.

(7) The light projecting unit may be detachably attached to the lensunit. In this case, it is easy to uniquely determine a positionalrelation between the light projecting unit and the lens unit. Since itis unnecessary to add a member that holds the light projecting unit tothe magnifying observation apparatus, it is possible to reduce themagnifying observation apparatus in size.

(8) A positioning mechanism that determines a position of the lightprojecting unit with respect to the lens unit may be formed in at leastone of the lens unit and the light projecting unit. In this case, it ispossible to uniquely determine, with a simple configuration, apositional relation between the light projecting unit and the lens unit.Consequently, it is possible to image the observation target with highreproducibility.

(9) A lens barrel section may be configured by the lens unit and theimaging section. The lens barrel section may be capable of incliningwhile maintaining a eucentric relation concerning a predeterminedposition on the placement surface of the stage. In this case, it ispossible to image the observation target from an angle inclined withrespect to the normal of the placement surface of the stage. Since theeucentric relation is maintained, even when the lens barrel section isinclined, it is possible to prevent a desired observation region of theobservation target from deviating from a visual field of the imagingsection.

(10) The lens barrel section may further include an inclinationdetecting section configured to detect an inclination angle of theoptical axis of the objective lens with respect to the normal of theplacement surface of the stage. In this case, the user can easilyrecognize an inclination angle of the lens barrel section as theinclination angle of the optical axis of the objective lens with respectto the normal of the placement surface of the stage.

(11) The magnifying observation apparatus may further include: a firstoperation section configured to receive an instruction for a start of anobservation by the user; and a control section configured to control, inresponse to the instruction received by the first operation section, thelight projecting unit to sequentially emit the lights in the first andsecond emitting directions respectively at the first and second lightirradiation times.

In this case, the first operation section receives the instruction forthe start of the observation from the user, whereby the lights in thefirst and second emitting directions are automatically sequentiallyirradiated on the observation target from the light projecting unit.Therefore, even when the user is unskilled, the user can easily generatethe first and second original image data.

(12) The control section may control the imaging section to receivelight for a first time period at the first light irradiation time andcontrol the imaging section to receive light for a second time periodlonger than the first time period at the second light irradiation time.

The first original image data is generated when light in the uniformfirst emitting direction is irradiated on the observation target.Therefore, an image indicated by the first original image data tends tobe brighter than an image indicated by the second original image data.Even in such a case, with the configuration explained above, a lightreception time of the imaging section at the time when the light in thesecond emitting direction is irradiated on the observation target isautomatically set longer than a light reception time of the imagingsection at the time when the light in the first emitting direction isirradiated on the observation target. Consequently, it is possible toeasily equalize the brightness of the image indicated by the firstoriginal image data and the brightness of the image indicated by thesecond original image data.

(13) The magnifying observation apparatus may further include a firstlight projecting section configured to irradiate light in a thirdemitting direction on the observation target from a position closer tothe optical axis of the objective lens than the emitting section of thelight projecting unit. At a third light irradiation time, the firstlight projecting section may irradiate the light in the third emittingdirection on the observation target and the imaging section may generatethird original image data. The data generating section may generate theimage data for display further on the basis of the third original imagedata.

In this case, the light in the third emitting direction is emitted tothe observation target by the first light projecting section from theposition closer to the optical axis of the objective lens than theemitting section of the light projecting unit. Consequently, in thethird original image data, unevenness on the surface of the observationtarget is more clearly shown. Therefore, by further using the thirdoriginal image data, it is possible to generate the image data fordisplay more clearly indicating the unevenness on the surface of theobservation target.

(14) The magnifying observation apparatus may further include a secondlight projecting section disposed to be opposed to the imaging sectionacross the observation target and configured to irradiate light in afourth emitting direction on the observation target. At a fourth lightirradiation time, the second light projecting section may irradiate thelight in the fourth emitting direction on the observation target and theimaging section may generate fourth original image data. The datagenerating section may generate the image data for display further onthe basis of the fourth original image data.

In this case, the light in the fourth emitting direction is emitted tothe observation target by the second light projecting section. The lighttransmitted through the observation target is received by the imagingsection. Consequently, in the fourth original image data, the structureon the inside of the observation target is indicated. Therefore, byfurther using the fourth original image data, it is possible to generatethe image data for display indicating the structure on the inside of theobservation target.

(15) The data generating section may generate the image data for displayby combining a plurality of original image data including at least oneof the first and second original image data. In this case, a pluralityof original image data corresponding to lights in a plurality ofemitting directions different from one another are combined.Consequently, it is possible to easily generate image data for displayindicating an image of the observation target that should be obtainedwhen it is assumed that light in any emitting direction is irradiated onthe observation target.

(16) The data generating section may determine rates of the combinationof the plurality of original image data on the basis of the specificemitting direction. In this case, it is possible to more easily generatethe image data for display on the basis of the plurality of originalimage data.

(17) The magnifying observation apparatus may further include a secondoperation section operated by the user in order to designate thespecific emitting direction. The data generating section may update,according to the specific emitting direction designated by the secondoperation section, the generated image data for display. In this case,by operating the second operation section to designate an appropriateemitting direction corresponding to the shape and the material of theobservation target, the user can easily acquire the image data fordisplay indicating an image of the observation target corresponding to arequest of the user.

According to the present invention, it is possible to easily acquire animage of the observation target corresponding to a request of the user.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic diagram showing the configuration of a magnifyingobservation apparatus according to a first embodiment of the presentinvention.

FIG. 2 is a block diagram showing the configuration of a control deviceshown in FIG. 1.

FIGS. 3A and 3B are a perspective view and a plan view showing theconfiguration of a light projecting section.

FIGS. 4A to 4C are schematic diagrams showing disposition examples ofthe light projecting section.

FIGS. 5A to 5D are schematic diagrams showing modifications of the lightprojecting section.

FIGS. 6A and 6B are an exterior perspective view of a measurement headand a schematic diagram showing the configuration of a lens barrelsection.

FIG. 7 is a schematic diagram showing a configuration example of a focusdriving section.

FIGS. 8A and 8B are schematic diagrams showing an example of apositioning mechanism.

FIG. 9 is a block diagram showing the configuration of an arithmeticprocessing section shown in FIG. 2.

FIG. 10 is a diagram showing a polar coordinate system defined on aplacement surface of a stage.

FIGS. 11A to 11J are schematic diagrams for explaining a basic operationof the magnifying observation apparatus at the time when pluralillumination imaging is designated.

FIG. 12 is a diagram showing a display example of an observation screen.

FIGS. 13A to 13C are schematic diagrams for explaining processingcontent at the time when an image of an observation target is updated inresponse to designation of an imaginary emitting direction of light.

FIG. 14 is a diagram showing an example in which light icons arerespectively displayed in a main display region and a sub-displayregion.

FIG. 15 is a diagram showing another display example of the observationscreen.

FIG. 16 is a diagram showing still another display example of theobservation screen.

FIG. 17 is a flowchart for explaining an example of plural illuminationimaging processing.

FIG. 18 is a flowchart for explaining an example of image-for-displaygeneration processing.

FIG. 19 is a flowchart for explaining the example of theimage-for-display generation processing.

FIGS. 20A and 20B are conceptual diagrams of depth synthesis processing.

FIG. 21 is a diagram visually showing mask image data.

FIG. 22 is a flowchart for explaining an example of the depth synthesisprocessing.

FIG. 23 is a flowchart for explaining the example of the depth synthesisprocessing.

FIG. 24 is a flowchart for explaining the example of the depth synthesisprocessing.

FIG. 25 is a flowchart for explaining another example of the depthsynthesis processing.

FIG. 26 is a flowchart for explaining the other example of the depthsynthesis processing.

FIG. 27 is a flowchart for explaining the other example of the depthsynthesis processing.

FIG. 28 is a flowchart for explaining an example of DR adjustmentprocessing.

FIG. 29 is a flowchart for explaining the example of the DR adjustmentprocessing.

FIG. 30 is a flowchart for explaining another example of the DRadjustment processing.

FIG. 31 is a flowchart for explaining the other example of the DRadjustment processing.

FIG. 32 is a schematic diagram showing the configuration of a magnifyingobservation apparatus according to a second embodiment of the presentinvention.

FIG. 33 is a diagram showing a display example of an observation screenafter plural illumination imaging processing according to the secondembodiment.

FIG. 34 is a schematic diagram showing the configuration of a magnifyingobservation apparatus according to a third embodiment of the presentinvention.

FIG. 35 is a diagram showing a display example of an observation screenafter plural illumination imaging processing according to the thirdembodiment.

FIG. 36 is a schematic diagram showing a modification of a lightprojecting section.

DESCRIPTION OF EMBODIMENTS [1] First Embodiment (1) Configuration of aMagnifying Observation Apparatus (a) Measurement Head

A magnifying observation apparatus according to a first embodiment ofthe present invention is explained with reference to the drawings. FIG.1 is a schematic diagram showing the configuration of the magnifyingobservation apparatus according to the first embodiment of the presentinvention. As shown in FIG. 1, a magnifying observation apparatus 1includes a measurement head 100 and a processing device 200. Themeasurement head 100 is, for example, an endoscope and includes a standsection 110, a stage device 120, a lens barrel section 130, a lightprojecting section 140, and a control board 150.

The stand section 110 has an L-shape in a longitudinal cross section andincludes a setting section 111, a holding section 112, and a focusdriving section 113. The setting section 111 and the holding section 112are formed by, for example, resin. The setting section 111 has ahorizontal flat shape and is set on a setting surface. The holdingsection 112 is provided to extend upward from one end portion of thesetting section 111.

The stage device 120 includes a stage 121 and a stage driving section122. The stage 121 is provided on the upper surface of the settingsection 111. An observation target S is placed on the stage 121. Twodirections orthogonal to each other in a plane on the stage 121 on whichthe observation target S is placed (hereinafter referred to as placementsurface) are defined as an X direction and a Y direction andrespectively indicated by arrows X and Y. A direction of a normalorthogonal to the placement surface of the stage 121 is defined as a Zdirection and indicated by an arrow Z. A direction of rotation around anaxis parallel to the Z direction is defined as a θ direction andindicated by an arrow θ.

The stage driving section 122 includes a not-shown actuator such as astepping motor. The stage driving section 122 moves the stage 121 in theX direction, the Y direction, or the Z direction or rotates the stage121 in the θ direction on the basis of a drive pulse given by thecontrol board 150. The user is also capable of manually moving the stage121 in the X direction, the Y direction, or the Z direction or rotatingthe stage 121 in the θ direction.

The lens barrel section 130 includes a lens unit 131 and an imagingsection 132 and is disposed above the stage 121. The lens unit 131 canbe replaced with another lens unit according to a type of theobservation target S. The lens unit 131 is configured by an objectivelens 131 a and a not-shown plurality of lenses. An optical axis A1 ofthe objective lens 131 a is parallel to the Z direction. The imagingsection 132 includes, for example, a CMOS (complementary metal oxidesemiconductor) camera. The imaging section 132 may include anothercamera such as a CCD (charge coupled device) camera.

The lens barrel section 130 is attached to the holding section 112 bythe focus driving section 113 of the stand section 110. The focusdriving section 113 includes a not-shown actuator such as a steppingmotor. The focus driving section 113 moves the lens unit 131 in thedirection of the optical axis A1 of the objective lens 131 a (the Zdirection) on the basis of a drive pulse given by the control board 150.Consequently, a focal position of light passed through the lens unit 131changes to the Z direction. The user is also capable of manually movingthe lens unit 131 in the direction of the optical axis A1 of theobjective lens 131 a.

The light projecting section 140 is integrally attached to the lens unit131 to surround the optical axis A1 of the objective lens 131 a.Consequently, it is possible to uniquely determine a positional relationbetween the light projecting section 140 and the lens unit 131. Since itis unnecessary to add a member that holds the light projecting section140 in the magnifying observation apparatus 1, it is possible to reducethe magnifying observation apparatus 1 in size. An optical axis A2(FIGS. 3A and 3B referred to below) of the light projecting section 140is substantially the same as the optical axis A1 of the objective lens131 a.

Lights in a plurality of emitting directions are irradiated on theobservation target S on the stage 121 from the light projecting section140. Light reflected to above the stage 121 by the observation target Sis condensed and focused by the lens unit 131 and thereafter received bythe imaging section 132. The imaging section 132 generates image data onthe basis of pixel data corresponding to light reception amounts ofpixels. Each of a plurality of image data respectively generated by theimaging section 132 at the time when the lights in the plurality ofemitting directions are irradiated on the observation target S by thelight projecting section 140 is referred to as original image data. Theimaging section 132 gives the generated plurality of original image datato a control device 400.

The control board 150 is provided in, for example, the holding section112 of the stand section 110 and connected to the focus driving section113, the stage driving section 122, and the imaging section 132. Thecontrol board 150 controls the operations of the focus driving section113 and the stage driving section 122 on the basis of control by theprocessing device 200. A control signal is input to the imaging section132 from the control device 400. A plurality of original image datagenerated by the imaging section 132 are sequentially given to theprocessing device 200 via a cable 203.

(b) Processing Device

The processing device 200 includes a housing 210, alight generatingsection 300, and the control device 400. The housing 210 houses thelight generating section 300 and the control device 400. The lightgenerating section 300 is optically connected to the light projectingsection 140 of the measurement head 100 by a fiber unit 201. The fiberunit 201 includes a not-shown plurality of optical fibers.

The light generating section 300 includes a light source 310 and a lightblocking section 320. The light source 310 is, for example, an LED(light emitting diode). The light source 310 may be another light sourcesuch as a halogen lamp. The light blocking section 320 is disposedbetween the light source 310 and the fiber unit 201 to be capable ofpartially blocking light emitted by the light source 310. The lightemitted by the light source 310 passes through the light blockingsection 320 and is made incident on the fiber unit 201. Consequently,light is emitted from the light projecting section 140 of themeasurement head 100 through the fiber unit 201.

FIG. 2 is a block diagram showing the configuration of the controldevice 400 shown in FIG. 1. As shown in FIG. 2, the control device 400includes a control section 410, a storing section 420, a display section430, an operation section 440, and a communication section 450. Thecontrol section 410 includes, for example, a CPU (central processingunit). The storing section 420 includes, for example, a ROM (read onlymemory), a RAM (random access memory), or a HDD (hard disk drive). Inthis embodiment, the control section 410 and the storing section 420 arerealized by a personal computer.

The control section 410 includes a driving control section 500 and anarithmetic processing section 600. A system program is stored in thestoring section 420. The storing section 420 is used for processing ofvarious data and saving of various data given from the control section410. Functions of the driving control section 500 and the arithmeticprocessing section 600 are realized by the control section 410 executingthe system program stored in the storing section 420.

The driving control section 500 includes a light-projection controlsection 510, an imaging control section 520, a focus control section530, and a stage control section 540. The light-projection controlsection 510 is connected to the light generating section 300 shown inFIG. 1 through a cable 202 and controls the operation of the lightgenerating section 300. The imaging control section 520, the focuscontrol section 530, and the stage control section 540 are connected tothe control board 150 of the measurement head 100 shown in FIG. 1through the cable 203.

The imaging control section 520, the focus control section 530, and thestage control section 540 respectively control the operations of theimaging section 132, the focus driving section 113, and the stagedriving section 122 through the control board 150. The imaging controlsection 520 sequentially gives a plurality of original image datagenerated by the imaging section 132 to the arithmetic processingsection 600.

The arithmetic processing section 600 can generate, on the basis of atleast one of the acquired plurality of original image data, image datafor display indicating an image of the observation target S that shouldbe obtained when it is assumed that light in an emitting directiondesignated by the user is irradiated on the observation target S.Details of the arithmetic processing section 600 are explained below.The plurality of original image data acquired by the arithmeticprocessing section 600 and the image data for display generated by thearithmetic processing section 600 are stored in the storing section 420.

The display section 430 is configured by, for example, an LCD (liquidcrystal display) panel. The display section 430 may be configured byanother display section such as an organic EL (electroluminescence)panel. The display section 430 displays, for example, an image based onthe image data stored in the storing section 420 or the image datagenerated by the arithmetic processing section 600. The operationsection 440 includes a pointing device such as a mouse, a touch panel, atrackball, or a joystick and a keyboard and is operated by the user inorder to give an instruction and the like to the control device 400. Theoperation section 440 may include a jog shuttle in addition to thepointing device and the keyboard. The operation section 440 may includedial-like operation means, a rotation center of which faces thehorizontal direction, for moving the lens barrel section 130 and thestage 121 in the up-down direction.

The communication section 450 includes an interface for connecting thecontrol device 400 to a network. In the example shown in FIG. 1, anexternal device 2 having a display function is connected to the network.The control device 400 is capable of transmitting image data to theexternal device 2 having the display function via the communicationsection 450 A user of the external device 2 can acquire image datastored in a general-purpose image file format from the control device400 via the communication section 450 and cause the external device 2 todisplay an image based on the image data.

(c) Light Projecting Section

FIGS. 3A and 3B are a perspective view and a plan view respectivelyshowing the configuration of the light projecting section 140. As shownin FIG. 3A, the light projecting section 140 includes a holding member141 and a plurality of optical fibers 142. The holding member 141 isformed by, for example, resin and has a cylindrical shape. The outerdiameter of the holding member 141 in plan view is smaller than thedimension of the stage 121 shown in FIG. 1. The holding member 141 isdisposed to surround the optical axis A1 of the objective lens 131 ashown in FIG. 1.

A plurality of through holes 141 a piercing through the holding member141 from the upper surface to the lower surface are formed in theholding member 141. The plurality of through holes 141 a are disposed atsubstantially equal intervals and located rotation-symmetrically aroundthe optical axis A1 of the objective lens 131 a. The plurality ofoptical fibers 142 are respectively inserted through the plurality ofthrough holes 141 a. Consequently, the plurality of optical fibers 142are integrally held by the holding member 141. Incident sections andemission sections of lights in the optical fibers 142 are respectivelylocated on the upper surface and the lower surface of the holding member141. Consequently, a light emitting section 140 o is formed on the lowersurface of the holding member 141.

The plurality of optical fibers 142 are disposed on one circumferencecentering on the optical axis A1 of the objective lens 131 a. Therefore,the distances from the optical axis A1 of the objective lens 131 a tothe emitting sections in the plurality of optical fibers 142 aresubstantially equal. An angle formed by lines, which connect theemitting sections in the optical fibers 142 and the center of the stage121, with respect to the optical axis A1 of the objective lens 131 a isan acute angle. In this embodiment, the holding member 141 integrallyholds the plurality of optical fibers 142, whereby a positional relationamong the plurality of optical fibers 142 is easily maintained.

As shown in FIG. 3B, the annular light emitting section 140 o of thelight projecting section 140 is substantially equally divided into aplurality of (in this example four) regions 140A, 140B, 140C, and 140D.The plurality of regions 140A to 140D are disposedrotation-symmetrically around the optical axis A1 of the objective lens131 a. The plurality of regions 140A to 140D include emitting sectionsof the optical fibers 142 generally as many as the plurality of regions140A to 140D.

The incident sections of the plurality of optical fibers 142 areoptically connected to the light generating section 300 of theprocessing device 200 by the fiber unit 201 shown in FIG. 1.Consequently, light emitted from the light generating section 300 ismade incident on the incident sections of the plurality of opticalfibers 142 from the upper surface of the holding member 141 and emittedfrom the light emitting section 140 o on the lower surface of theholding member 141 through the emitting sections of the plurality ofoptical fibers 142. That is, the optical fibers 142 included in theregions 140A to 140D emit lights from the light emitting section 140o,whereby the lights are emitted from the regions 140A to 140D.

The light blocking section 320 shown in FIG. 1 include a mask includinga plurality of opening patterns respectively corresponding to theregions 140A to 140D of the light projecting section 140. Light emittedby the light source 310 shown in FIG. 1 passes through any one of theopening patterns of the light blocking section 320 and is made incidenton the fiber unit 201. The light-projection control section 510 shown inFIG. 2 switches the opening pattern of the light blocking section 320for allowing the light to pass to thereby switch the regions 140A to140D from which lights are emitted in the light projecting section 140.Consequently, the light projecting section 140 is capable of emittinglights from the entire regions 140A to 140D and capable of selectivelyemitting light from any one of the regions 140A to 140D.

In this way, the light projecting section 140 can irradiate the lightshaving the emitting directions different from one another on theobservation target S. Lights simultaneously emitted from the entireregions 140A to 140D are referred to as ring illumination. Light emittedfrom any one region of the regions 140A to 140D is referred to asdirectional illumination. In this embodiment, the light projectingsection 140 is capable of selectively emitting the ring illumination andany one of four directional illuminations. Therefore, the imagingsection 132 shown in FIG. 1 is capable of generating five original imagedata indicating the observation target S at the time when the ringillumination and the four directional illuminations are respectivelyirradiated on the observation target S.

The four directional illuminations are lights respectively emitted fromfour positions (the regions 140A to 140D) different from one another byapproximately 90° in the θ direction around the optical axis A1 of theobjective lens 131 a. The four directional illuminations arerotation-symmetrical around the optical axis A1 of the objective lens131 a. Therefore, the directional illuminations have deviation from theoptical axis A1 of the objective lens 131 a. The four directionalilluminations are emitted in directions inclined with respect to theoptical axis Al of the objective lens 131 a and different from oneanother. Light amounts of the four directional illuminations aresubstantially equal to one another. Angles of irradiation of the fourdirectional illuminations with respect to the optical axis A1 of theobjective lens 131 a are not uniform according to the θ direction.

On the other hand, the ring illumination is light not deviating from theoptical axis A1 of the objective lens 131 a. The center of the ringillumination substantially coincides with the optical axis A1 of theobjective lens 131 a. Therefore, the ring illumination is emittedsubstantially in the direction of the optical axis A1 of the objectivelens 131 a. The ring illumination has a substantially uniform lightamount distribution around the optical axis A1 of the objective lens 131a. A light amount of the ring illumination is substantially equal to asum of light amounts of the four directional illuminations. That is, thelight amount of the ring illumination is approximately four times aslarge as the light amount of each of the directional illuminations. Anangle of irradiation of the ring illumination with respect to theoptical axis A1 of the objective lens 131 a is uniform according to theθ direction.

As explained above, in this embodiment, the plurality of regions 140A to140D are disposed rotation-symmetrically around the optical axis A1 ofthe objective lens 131 a. Consequently, when image data for display isgenerated by an arithmetic operation on the basis of the plurality oforiginal image data, it is possible to simplify the arithmeticoperation.

In this embodiment, the optical fibers 142 are provided as the lightemitting members in the regions 140A to 140D of the light projectingsection 140. However, the present invention is not limited to this.Light sources such as LEDs may be provided as the light emitting membersin the regions 140A to 140D of the light projecting section 140. In thiscase, the light generating section 300 is not provided in the processingdevice 200. In this configuration, one or a plurality of light sourcesprovided in each of the regions 140A to 140D emit lights, whereby thelights are emitted from the regions 140A to 140D.

In this way, the light projecting section 140 is provided as the lightprojecting unit around the optical axis A1 of the objective lens 131 aof the lens barrel section 130. Since a plurality of illuminationemitting sections can be integrally treated as a unit, it is unnecessaryto individually set a light source for each of the emitting sections.Consequently, an installation property and an attachment property of thelight projecting section 140 are improved.

FIGS. 4A to 4C are schematic diagrams showing disposition examples ofthe light projecting section 140. In this embodiment, as shown in FIG.4A, the light projecting section 140 is attached to the lens unit 131.The present invention is not limited to this. As shown in FIG. 4B, thelight projecting section 140 may be disposed on the stage 121.Alternatively, as shown in FIG. 4C, the light projecting section 140 maybe disposed between the stage 121 and the lens unit 131 and held in thestand section 110 by a holding section 114.

Further, in this embodiment, the four regions 140A to 140D from whichlights are emitted are provided in the light projecting section 140.However, the present invention is not limited to this. Three or less orfive or more regions from which lights are emitted may be provided inthe light projecting section 140.

In this embodiment, the plurality of light emitting members (the opticalfibers 142) are disposed on one circumference centering on the opticalaxis A1 of the objective lens 131 a. However, the present invention isnot limited to this. The plurality of light emitting members maybedisposed on two or more concentric circles centering on the optical axisAl of the objective lens 131 a. Further, in this embodiment, theplurality of light emitting members are disposed in each of the regions140A to 140D. However, the present invention is not limited to this. Onelight emitting member may be disposed in each of the regions 140A to140D.

FIGS. 5A to 5D are schematic diagrams showing a modification of thelight projecting section 140. In the example shown in FIG. 5A, the lightprojecting section 140 is attached to the lens unit 131 in a state inwhich the adjacent regions 140A to 140D are separated from one anotherwithout being in contact with one another. The example shown in FIG. 5Bis the same as the example shown in FIG. 5A except that the plurality ofregions 140A to 140D are attached to the lens unit 131 respectively byfixing members 143 such as screws. The example shown in FIG. 5C is thesame as the example shown in FIG. 5A except that the light projectingsection 140 is attached to a member different from the lens unit 131. Inthis case, the lens unit 131 and the regions 140A to 140D are slightlyseparated from each other.

In the example shown in FIG. 5D, a plurality of (in this example, eight)circular regions 140A to 140H are disposed to surround the lens unit 131at substantial equal angle intervals. One or a plurality of opticalfibers 142 are provided in each of the regions 140A to 140H. One or aplurality of light emitting members are provided in each of the regions140A to 140H. The regions 140A to 140H are fixed to one another innot-shown portions. In this way, the light projecting section 140 isconfigured as a unit such that a positional relation among a pluralityof light emission regions does not change.

In this way, in the examples shown in FIGS. 5A to 5D, the regionsconfiguring the light projecting section 140 integrally configure alight projecting unit. Therefore, it is possible to overcome a problemin that labor and time of disposition design are increased byindividually setting the respective light sources. It is possible toovercome a problem in that a desired image is not obtained because thelight sources are not appropriately disposed.

The light projecting section 140 can be configured as the lightprojecting unit such that a distance relation among the plurality oflight sources does not change. By configuring the light projectingsection 140 as the light projecting unit, it is possible to improvecontrollability of switching of full lighting, partial lighting, patternlighting, and the like of the light sources. The optical axis A1 of theobjective lens 131 a and the optical axis A2 of the light projectingsection 140 substantially coincide with each other.

(d) Lens Barrel Section

FIGS. 6A and 6B are respectively an exterior perspective view of themeasurement head 100 and a schematic diagram showing the configurationof the lens barrel section 130. As shown in FIG. 6A, the measurementhead 100 includes an inclining mechanism 101 for inclining the lensbarrel section 130 with respect to the stage 121. The incliningmechanism 101 supports an upper part of the holding section 112 withrespect to a lower part of the holding section 112 in a plane orthogonalto the Y direction. Consequently, the inclining mechanism 101 canincline the lens barrel section 130 with respect to the stage 121 aroundan inclination center 130 c. In FIG. 6B, the lens barrel section 130after the inclination is indicated by an alternate long and short dashline.

The stage 121 moves in the Z direction on the basis of control by thestage control section 540 shown in FIG. 2 such that the surface of theobservation target S is located at height substantially the same as theheight of the inclination center 130 c of the lens barrel section 130.Therefore, even if the lens barrel section 130 is inclined, a eucentricrelation in which a visual field of the imaging section 132 does notmove is maintained. It is possible to prevent a desired observationregion of the observation target S from deviating from the visual fieldof the imaging section 132.

As shown in FIG. 6B, the lens barrel section 130 includes a lens unit131, an imaging section 132, and an inclination sensor 133. The imagingsection 132 receives, via the lens unit 131, light from the observationtarget S placed on the placement surface of the stage 121 and generatesoriginal image data on the basis of control by the imaging controlsection 520 shown in FIG. 2.

The imaging control section 520 controls a light reception time, a gain,timing, and the like of the imaging section 132. For example, theimaging control section 520 adjusts a light reception time duringirradiation of the directional illuminations on the basis of a lightreception time during irradiation of the ring illumination. In thisexample, as explained above, the light amount of the ring illuminationis approximately four times as large as the light amount of each of thedirectional illuminations. Therefore, the imaging control section 520adjusts the light reception time during the irradiation of thedirectional illuminations to be four times as long as a light receptiontime during the irradiation of the ring illumination.

With this control, the imaging section 132 can generate original imagedata at high speed compared with when the light reception times duringthe irradiation of the directional illuminations are independentlyadjusted. The imaging section 132 can easily substantially equalizebrightness of an image during the irradiation of the ring illuminationand brightness of an image during the irradiation of the directionalilluminations. Note that, in this example, control contents of theimaging section 132 during the irradiation of the plurality ofdirectional illuminations are the same one another.

The imaging section 132 can generate a plurality of original image datain a state in which a light reception time is changed to a plurality oftimes by the imaging control section 520. The arithmetic processingsection 600 shown in FIG. 2 can generate image data with an adjusteddynamic range by selectively combining the plurality of original imagedata generated in the state in which the light reception time of theimaging section 132 is changed to the plurality of times (DR (dynamicrange) adjustment processing).

An inclination angle of the optical axis A1 of the objective lens 131 awith respect to the Z direction (hereinafter referred to as inclinationangle of the lens barrel section 130) is detected by the inclinationsensor 133. An angle signal corresponding to the inclination angle isoutput to the control board 150 shown in FIG. 1. The control board 150gives the angle signal output by the inclination sensor 133 to thearithmetic processing section 600 via the cable 203 and the imagingcontrol section 520 shown in FIG. 2. The arithmetic processing section600 calculates an inclination angle of the lens barrel section 130 onthe basis of the angle signal. It is possible to cause the displaysection 430 shown in FIG. 1 to display the inclination angle calculatedby the arithmetic processing section 600.

With the configuration explained above, it is possible to selectivelyperform a plane observation and an inclined observation of theobservation target S placed on the placement surface of the stage 121.During the plane observation, the optical axis A1 of the objective lens131 a is parallel to the Z axis. That is, the inclination angle of thelens barrel section 130 is 0°. On the other hand, during the inclinedobservation, the optical axis A1 of the objective lens 131 a inclineswith respect to the Z direction. The user can perform observation of theobservation target S in a state in which the lens barrel section 130 isdetached from the stand section 110 shown in FIG. 1 and fixed by a handor another fixing member. In the following explanation, the planeobservation of the observation target S is performed.

(e) Focus Driving Section

The focus control section 530 shown in FIG. 2 controls the focus drivingsection 113 shown in FIG. 1 such that a focal position of light from theobservation target S passed through the lens unit 131 changes in the Zdirection relatively to the observation target S. Consequently, theimaging section 132 shown in FIG. 1 can generate a plurality of originalimage data indicating the observation target S in different positions inthe Z direction.

In this processing, the user can designate a range in which the focusdriving section 113 moves in the Z direction. When the moving range isdesignated, the focus control section 530 controls the focus drivingsection 113 such that a focal position of light changes in the Zdirection in the designated moving range. Consequently, the imagingsection 132 can generate, in a short time, the plurality of originalimage data indicating the observation target S in the differentpositions in the Z direction.

The arithmetic processing section 600 can determine a focus degree ofeach of pixels concerning each of the generated plurality of originalimage data indicating the observation target S in the differentpositions in the Z direction. The focus control section 530 can adjustthe focus driving section 113 on the basis of a determination result ofthe focus degree by the arithmetic processing section 600 such that theimaging section 132 is focused on a specific portion of the observationtarget S (autofocus processing). Further, the arithmetic processingsection 600 can generate image data focused on all portions of theobservation target S by selectively combining the plurality of originalimage data for each of the pixels on the basis of the determinationresult of the focus degree (depth synthesis processing).

FIG. 7 is a diagram showing a configuration example of the focus drivingsection 113. In this embodiment, the light projecting section 140 isattached to the lens unit 131. As indicated by a dotted line in FIG. 7,the lens unit 131 is moved in the Z direction by the focus drivingsection 113 integrally with the light projecting section 140. Asindicated by an alternate long and short dash line in FIG. 7, the stage121 is moved in the Z direction by the stage driving section 122 shownin FIG. 1. In this way, the lens unit 131 and the light projectingsection 140 and the stage 121 are capable of relatively moving in the Zdirection.

When a positional relation in the Z direction among the observationtarget S, the lens unit 131, and the light projecting section 140changes, an angle of elevation of a light source that irradiatesillumination on the observation target S (see FIG. 10 referred to below)changes. In the example shown in FIG. 7, the light projecting section140 is integrally provided in the lens barrel section 130. However, thepresent invention is not limited to this. The light projecting section140 may be detachably attached to the lens barrel section 130 as a unit.In this case, a positioning mechanism for maintaining an angle relationbetween the light projecting section 140 and the lens unit 131 in the θdirection constant is desirably provided in the lens unit 131 or thelight projecting section 140.

FIGS. 8A and 8B are schematic diagrams showing an example of thepositioning mechanism. FIG. 8A shows a side view of the measurement head100 in a state in which the light projecting section 140 is detachedfrom the lens unit 131. In the example shown in FIG. 8A, a groovesection 131 b is formed on the outer circumferential surface of a lowerpart of the lens unit 131. [0086]

FIG. 8B shows a plan view of the light projecting section 140. In theexample shown in FIG. 8B, a protrusion section 141 b projecting inwardis formed on the inner circumferential surface of the holding member141. The holding member 141 is attached to the lens unit 131 in a statein which the protrusion section 141 b is fit in the groove section 131b. Consequently, an angle relation between the light projecting section140 and the lens unit 131 in the θ direction is maintained constant.Therefore, it is possible to image the observation target S with highreproducibility.

In the example shown in FIG. 8A, the positioning mechanism is formed bythe groove section 131 b and the protrusion section 141 b. However, thepresent invention is not limited to this. For example, when the holdingmechanism 141 is attached to the lens unit 131 by screws, the screws andscrew holes may form the positioning mechanism. Alternatively, anotherstructure such as a cutout or a mark may form the positioning mechanism.

Although not shown in FIGS. 8A and 8B, as shown in FIG. 1, the lens unit131 and the imaging section 132 can also be attached with flexibility inthe θ direction. The light projecting section 140 and the like may bepositioned and attached on the basis of the position in the θ directionof either one of the lens unit 131 and the imaging section 132.

(f) Arithmetic Processing Section

FIG. 9 is a block diagram showing the configuration of the arithmeticprocessing section 600 shown in FIG. 2. As shown in FIG. 9, thearithmetic processing section 600 includes a data generating section610, a focus determining section 620, a calculating section 630, and acondition setting section 640.

The data generating section 610 generates image data for display on thebasis of at least one of a plurality of original image data generated bythe imaging section 132 shown in FIG. 1. The data generating section 610performs DR adjustment processing or depth synthesis processing on imagedata according to an instruction of the user.

When the focus control section 530 shown in FIG. 2 performs theautofocus processing, the focus determining section 620 determines afocus degree of each of pixels concerning each of a plurality oforiginal image data generated according to movement in the Z directionof the focus driving section 113. When the data generating section 610performs the depth synthesis processing, the focus determining section620 determines a focus degree of each of pixels concerning the pluralityof original image data.

The calculating section 630 calculates an inclination angle of the lensbarrel section 130 shown in FIG. 6B on the basis of an angle signaloutput by the inclination sensor 133 shown in FIG. 6B. The calculatingsection 630 causes, according to an instruction of the user, the displaysection 430 shown in FIG. 2 to display the calculated inclination angleof the lens barrel section 130.

The condition setting section 640 includes an imaging-condition settingsection 641 and an illumination-condition setting section 642. Theimaging-condition setting section 641 sets imaging conditions accordingto an instruction of the user. The condition setting section 640 causesthe storing section 420 shown in FIG. 1 to store imaging informationindicating the set imaging conditions. The imaging conditions include,for example, a light reception time of the imaging section 132 shown inFIG. 1, presence or absence of execution of the DR adjustmentprocessing, presence or absence of execution of the depth synthesisprocessing, and a range of a focal position of light in the Z direction.The driving control section 500 shown in FIG. 2 controls the operationsof the measurement head 100 and the light generating section 300 shownin FIG. 1 on the basis of the imaging conditions set by theimaging-condition setting section 641.

The illumination-condition setting section 642 sets illuminationconditions according to an instruction of the user. Theillumination-condition setting section 642 causes the storing section420 to store illumination information corresponding to the setillumination conditions. The illumination conditions include animaginary emitting direction of light with respect to the observationtarget S. The data generating section 610 generates image data fordisplay on the basis of the illumination conditions set by theillumination-condition setting section 642 and causes the storingsection 420 to store the image data for display. An instruction methodfor illumination conditions by the user is explained below.

(2) Basic Operation of the Magnifying Observation Apparatus (a) Contentof the Basic Operation

A position where the optical axis A1 of the objective lens 131 a crosseson the placement surface of the stage 121 is referred to as referencepoint. The observation target S is placed on the stage 121 such that anobservation target portion is located on the reference point. In thisstate, the position in the Z direction of the lens unit 131 (FIG. 1) isadjusted such that the objective lens 131 a is focused on at least apart of the observation target S. The stage 121 is adjusted in the Xdirection and the Y direction such that a desired portion of theobservation target S can be observed. Further, imaging conditions suchas a light reception time and a white balance of the imaging section 132are adjusted.

In the following explanation, in order to distinguish the fourdirectional illuminations, lights emitted from the respective regions140A, 140B, 140C, and 140D of the light projecting section 140 arerespectively referred to as first directional illumination, seconddirectional illumination, third directional illumination, and fourthdirectional illumination. In the following explanation, a travelingdirection of a ray obtained when a plurality of rays forming the ringillumination are combined in terms of a vector is referred to as ringemitting direction. The ring emitting direction is a directionperpendicular to the placement surface of the stage 121. A travelingdirection of a ray obtained when a plurality of rays forming the firstdirectional illumination are combined in terms of a vector is referredto as first emitting direction. A ray obtained when a plurality of raysforming the second directional illumination are combined in terms of avector is referred to as second emitting direction. Further, a travelingdirection of a ray obtained when a plurality of rays forming the thirddirectional illumination are combined in terms of a vector is referredto as third emitting direction. A traveling direction of a ray obtainedwhen a plurality of rays forming the fourth directional illumination arecombined in terms of a vector is referred to as fourth emittingdirection.

A polar coordinate system having the reference point as the origin isdefined on the placement surface of the stage 121 such that it ispossible to specify an emitting direction or an emitting position oflight at the time when the light is irradiated on the observation targetS placed on the reference point. FIG. 10 is a diagram showing the polarcoordinate system defined on the placement surface of the stage 121. Asshown in FIG. 10, the reference point on the placement surface of thestage 121 is defined as an origin O. As indicated by a thick solid linein FIG. 10, an azimuth angle is defined in a direction counterclockwisearound the origin O in a state in which the placement surface of thestage 121 is viewed from above. In this example, a direction from theorigin O to one side of the magnifying observation apparatus 1 isdefined as a reference angle (0°) of the azimuth angle.

A point Q is assumed in any position on the placement surface or abovethe placement surface. In this case, as indicated by a thick alternatelong and short dash line in FIG. 10, an angle between a straight lineconnecting the point Q and the origin O and the placement surface isdefined as an angle of elevation of the point Q. When the point Q ispresent on the placement surface, the angle of elevation of the point Qis 0°. When the point Q is present above the placement surface and onthe optical axis A1, the angle of elevation of the point Q is 90°. InFIG. 10, the azimuth angle on the placement surface of the stage 121 isshown at every 90°. In the following explanation, when any positionabove the placement surface of the stage 121, a direction of lightirradiated on the observation target S, or the like is explained, the“angle of elevation” and the “azimuth angle” defined as explained aboveare used as appropriate.

In this example, center portions of the regions 140A, 140B, 140C, and140D of the light projecting section 140 are respectively disposed atazimuth angles of 45°, 135°, 225°, and 315° around the optical axis A1.Note that the disposition of the light projecting section 140 is notlimited to the example explained above. For example, the center portionsof the regions 140A, 140B, 140C, and 140D may be respectively disposedat azimuth angles of 0°, 90°, 180°, and 270° around the optical axis A1.Sequentially imaging the observation target S using the ringillumination and the first to fourth directional illuminations isreferred to as plural illumination imaging.

The components of the magnifying observation apparatus 1 perform thefollowing basic operations in response to instruction for the pluralillumination imaging. FIGS. 11A to 11J are schematic diagrams forexplaining a basic operation of the magnifying observation apparatus 1at the time when the plural illumination imaging is instructed. In FIGS.11A to 11E, changes in illumination irradiated on the observation targetS are shown in time series. In FIGS. 11A to 11E, a region of the lightprojecting section 140 that emits light is indicated by a thick solidline. The ring emitting direction and the first to fourth emittingdirections are respectively indicated by thick solid line arrows. InFIGS. 11F to 11J, an image SI of the observation target S at the timewhen the illuminations shown in FIGS. 11A to 11E are irradiated on theobservation target S is shown. In the following explanation, a displayportion of the observation target S in an image in which the observationtarget S is displayed is referred to as target partial image sp.

As shown in FIG. 11A, first, the ring illumination is irradiated on theobservation target S and the observation target S is imaged. In thiscase, the first to fourth directional illuminations are simultaneouslyand uniformly irradiated on portions of the observation target S fromall of the regions 140A to 140D surrounding the optical axis A1 of theobjective lens 131 a. Consequently, as shown in FIG. 11F, in the imageSI of the observation target S imaged by the ring illumination, shadowsdue to the shape of the observation target S hardly occur in the targetpartial image sp. Therefore, it is possible to substantially entirelyobserve a surface state of a portion facing upward in the observationtarget S.

Subsequently, as shown in FIG. 11B, only the first directionalillumination is irradiated on the observation target S. The observationtarget S is imaged. As shown in FIG. 11G, in the image SI of theobservation target S imaged by the first directional illumination,shadows SH in the first emitting direction and in a direction from aposition of the azimuth angle of 45° to a position of the azimuth angleof 225° corresponding to the shape of the observation target S occur ina part of the target partial image sp. Consequently, an uneven portionin the observation target S is strongly emphasized in the first emittingdirection.

Subsequently, as shown in FIG. 11C, only the second directionalillumination is irradiated on the observation target S. The observationtarget S is imaged. As shown in FIG. 11H, in the image SI of theobservation target S imaged by the second directional illumination, theshadows SH in the second emitting direction and in a direction from aposition of the azimuth angle of 135° to a position of the azimuth angleof 315° corresponding to the unevenness of the observation target Soccur in a part of the target partial image sp. Consequently, the unevenportion in the observation target S is strongly emphasized in the secondemitting direction.

Subsequently, as shown in FIG. 11D, only the third directionalillumination is irradiated on the observation target S. The observationtarget S is imaged. As shown in FIG. 11I, in the image SI of theobservation target S imaged by the third directional illumination, theshadows SH in the third emitting direction and in a direction from aposition of the azimuth angle of 225° to a position of the azimuth angleof 45° corresponding to the unevenness of the observation target S occurin a part of the target partial image sp. Consequently, the unevenportion in the observation target S is strongly emphasized in the thirdemitting direction.

Subsequently, as shown in FIG. 11E, only the fourth directionalillumination is irradiated on the observation target S. The observationtarget S is imaged. As shown in FIG. 11J, in the image SI of theobservation target S imaged by the fourth directional illumination, theshadows SH in the fourth emitting direction and in a direction from aposition of the azimuth angle of 315° to a position of the azimuth angleof 135° corresponding to the unevenness of the observation target Soccur in a part of the target partial image sp. Consequently, the unevenportion in the observation target S is strongly emphasized in the fourthemitting direction.

The series of operation explained above is automatically performed bythe control section 410 shown in FIG. 1 executing the systemprogramstored in the storing section 420. However, the series of operationmaybe manually performed on the basis of operation by the user.

When the plural illumination imaging is completed, an observation screenis displayed on the display section 430 shown in FIG. 1. FIG. 12 is adiagram showing a display example of the observation screen. As shown inFIG. 12, a function display region 431 is set in an upper part of anobservation screen 430A. In the function display region 431, a depthsynthesis button b1, a DR adjustment button b2, and a saving button b7are displayed.

The user can operate the buttons displayed in the function displayregion 431 using the operation section 440 shown in FIG. 1. Contents ofprocessing respectively executed by operating the depth synthesis buttonb1, the DR adjustment button b2, and the saving button b7 are explainedbelow.

As shown in FIG. 12, a main display region 432 and a sub-display region433 are set to be arranged side by side on the left and the right belowthe function display region 431. The main display region 432 has a largearea compared with the function display region 431 and the sub-displayregion 433. In an initial state, any one of a plurality of images SIbased on a plurality of original image data generated by the immediatelypreceding plural illumination imaging is displayed over substantiallythe entire main display region 432. In this example, the image SI (seeFIGS. 11B and 11G) of the observation target S at the time when thefirst directional illumination is irradiated is displayed in the maindisplay region 432.

In the sub-display region 433, an emitting-direction designation field433 a and an emitting-direction display field 433 b are displayed. Inthe emitting-direction designation field 433 a, a target position imagess0 indicating the position of the observation target S on the placementsurface is displayed. A light icon ss1 indicating an emitting positionof light with respect to the observation target S at the time when theobservation target S is viewed from a position above the lightprojecting section 140 is superimposed and displayed on the targetposition image ss0.

In this case, a relative positional relation between the target portionimage sp of the observation target S and the light icon ss1 on thetarget position image ss0 corresponds to an emitting direction of lightthat should be irradiated on the observation target S in order to obtainthe image SI displayed in the main display region 432 (hereinafterreferred to as imaginary emitting direction of light).

The user can easily designate the imaginary emitting direction of lightwhile grasping an imaginary emitting position of light by moving, usingthe operation section 440 shown in FIG. 1, the light icon ss1 shown inFIG. 12 relatively to the target partial image sp of the observationtarget S on the target position image ss0.

The imaginary emitting direction of light is designated by the user,whereby the image SI of the observation target S displayed in the maindisplay region 432 is updated to the image SI of the observation targetS that should be obtained when it is assumed that light in a designatedemitting direction is irradiated on the observation target S. The updateprocessing of the image SI is executed by the data generating section610 shown in FIG. 9.

In the emitting-direction display field 433 b, an image indicating thereference point on the placement surface is displayed as a referencepoint image ss2 and an image of an imaginary hemisphere covering thereference point on the stage 121 is stereoscopically displayed as ahemispherical image ss3. On the hemispherical image ss3, an imageindicating an emitting direction of light corresponding to an imaginaryemitting direction of light designated by the light icon ss1 isdisplayed as an emitting position image ss4.

Further, a straight line is displayed to connect the emitting positionimage ss4 and the reference point image ss2 on the hemispherical imagess3. In this case, a direction from the emitting position image ss4 tothe reference point image ss2 on the straight line indicates theemitting direction of light designated by the light icon ss1. The usercan easily and accurately recognize the virtual emitting direction oflight designated by the light icon ss1 by visually recognizing thereference point image ss2, the hemispherical image ss3, and the emittingposition image ss4 displayed in the emitting-direction display field 433b.

The magnifying observation apparatus 1 may be configured to be capableof selecting only a part of the ring illumination and the first tofourth directional illuminations as illumination used for the pluralillumination imaging. When the plural illumination imaging is performedusing only a part of the ring illumination and the first to fourthdirectional illuminations, a range of an emitting direction that can bedesignated by the light icon ss1 is sometimes limited.

In this case, in the hemispherical image ss3, the range of the emittingdirection that can be designated by the light icon ss1 in theemitting-direction designation field 433 a may be displayed to bedistinguishable from a range of an emitting direction that cannot bedesignated. For example, when the range of the emitting direction thatcan be designated is limited to a range of a specific azimuth angle, adisplay form such as a color may be differentiated between a portioncorresponding to a range of an azimuth angle that can be designated anda portion corresponding to a range of an azimuth angle that cannot bedesignated. Consequently, the user can easily recognize the range of theemitting direction that can be designated by the light icon ss1.Alternatively, in the hemispherical image ss3, instead of the exampleexplained above, only the range of the emitting direction that can bedesignated by the light icon ss1 may be displayed.

In this example, in the emitting-direction display field 433 b, theimaginary hemisphere covering the reference point is stereoscopicallydisplayed as the hemispherical image ss3. However, the present inventionis not limited to this. In the emitting-direction display field 433 b, aplane hemispherical image obtained by viewing, from above, the imaginaryhemisphere covering the reference point and a side hemispherical imageobtained by viewing the imaginary hemisphere from one side may bedisplayed. In this case, the reference point image ss2 and the emittingposition image ss4 may be displayed on the plane hemispherical image.The reference point image ss2 and the emitting position image ss4 may bedisplayed on the side hemispherical image.

FIGS. 13A to 13C are schematic diagrams for explaining processingcontent at the time when the image SI of the observation target S isupdated in response to the designation of the imaginary emittingdirection of light.

In the magnifying observation apparatus 1, a plane coordinate systemdecided in advance concerning the target position images ss0 displayedin the sub-display region 433 shown in FIG. 12 is defined. Further, asshown in FIG. 13A, on the target position image ss0 shown in FIG. 12,points PA, PB, PC, PD, and PE indicating emitting positions of the ringillumination and lights respectively corresponding to the first, second,third, and fourth emitting directions are set in advance.

Positions of the points PA to PE are set, for example, on the basis of arelative positional relation between the light projecting section 140and the stage 121. In this example, the point PA is located in thecenter of the target position image ss0. The points PB, PC, PD, and PEare arranged at equal angle intervals on a concentric circle centeringon the point PA.

The control section 410 detects a position (a coordinate) on the targetposition image ss0 of the light icon ss1 at a cycle decided in advanceand causes the display section 430 to display, in the main displayregion 432 shown in FIG. 12, the image SI of the observation target Scorresponding to the position of the light icon ss1.

For example, the control section 410 causes the display section 430 todisplay, in the main display region 432 shown in FIG. 12, the image SIshown in FIG. 11F corresponding to the ring emitting direction when thelight icon ss1 is located on the point PA shown in FIG. 13A. The controlsection 410 causes the display section 430 to display, in the maindisplay region 432 shown in FIG. 12, the image SI shown in FIG. 11Gcorresponding to the first emitting direction when the light icon ss1 islocated on the point PB shown in FIG. 13A. The control section 410causes the display section 430 to display, in the main display region432 shown in FIG. 12, the image SI shown in FIG. 11H corresponding tothe second emitting direction when the light icon ss1 is located on thepoint PC shown in FIG. 13A. Further, the control section 410 causes thedisplay section 430 to display, in the main display region 432 shown inFIG. 12, the image SI shown in FIG. 11I corresponding to the thirdemitting direction when the light icon ss1 is located on the point PDshown in FIG. 13A. The control section 410 causes the display section430 to display, in the main display region 432 shown in FIG. 12, theimage SI shown in FIG. 11J corresponding to the fourth emittingdirection when the light icon ss1 is located on the point PE shown inFIG. 13A.

When the light icon ss1 is present in a position different from thepoints PA to PE, the control section 410 generates, according to aprocedure explained below, the image SI of the observation target S thatthe control section 410 should cause the main display region 432 todisplay.

As shown in FIG. 13A, when the light icon ss1 is present in a positiondifferent from the points PA to PE, the control section 410 calculatesdistances between the points PA to PE and the light icon ss1. Thecontrol section 410 extracts the number of points decided in advance (inthis example, three points) out of the plurality of points PA to PE inan ascending order of the calculated distances. In the example shown inFIG. 13A, a distance d1 between the light icon ss1 and the point PB isthe shortest. A distance d2 between the light icon ss1 and the point PAis the second shortest. A distance d3 between the light icon ss1 and thepoint PC is the third shortest. Therefore, the control section 410extracts the points PA, PB, and PC.

Subsequently, the control section 410 determines, on the basis of thedistances d1, d2, and d3, combination rates of original image datacorresponding to the point PA, original image data corresponding to thepoint PB, and original image data corresponding to the point PC.

The combination rates are, for example, ratios of inverses of values ofthe distances d1, d2, and d3. In this case, the combination rate ishigher in original image data corresponding to a point, the distance towhich from the light icon ss1 is shorter, and is lower in original imagedata corresponding to a point, the distance to which from the light iconss1 is longer. In the example shown in FIG. 13B, the combination ratesof the original image data corresponding to the point PA, the originalimage data corresponding to the point PB, and the original image datacorresponding to the point PC are respectively determined as 30%, 50%,and 20%.

The control section 410 combines the three original image datarespectively corresponding to the points PA, PB, and PC on the basis ofthe determined combination rates. Specifically, the control section 410multiplies, for each of the original image data, value (pixel values) ofall pixel data of the original image data with the combination rate andcombines the three original image data after the multiplication tothereby generate image data for display. Thereafter, the control section410 causes the display section 430 to display, in the main displayregion 432 shown in FIG. 12, the image SI based on the generated imagedata for display.

In FIG. 13C, an example of the image SI displayed in the main displayregion 432 according to the position of the light icon ss1 shown in FIG.13A is shown. In the image SI shown in FIG. 13C, the three originalimage data respectively corresponding to the points PA, PB, and PC arecombined, whereby the uneven portion in the observation target S isstrongly emphasized in the imaginary emitting direction of lightdesignated by the light icon ss1 shown in FIG. 13A.

As explained above, after the completion of the plural illuminationimaging, the image data of the image SI displayed in the main displayregion 432 is generated on the basis of the generated plurality oforiginal image data and the imaginary emitting direction of lightdesignated by the user. Therefore, even if the imaginary emittingdirection of light designated by the user continuously changes, aplurality of image data corresponding to the designated emittingdirection are substantially continuously generated at speedcorresponding to a processing ability of the control section 410. Theimage SI based on the generated plurality of image data is continuouslydisplayed. Therefore, a video substantially the same as a video (amoving image) obtained by continuously performing imaging while changingthe position of illumination is simulatively reproduced on the maindisplay region 432. Consequently, the user visually recognizes the imageSI on the main display region 432 while designating the imaginaryemitting direction of light to thereby feel as if the light in thedesignated emitting direction is irradiated on the observation target Son a real time basis.

In the example explained above, the control section 410 extracts thethree points among the points PA to PE corresponding to the ringillumination and the first to fourth directional illuminations anddetermines the combination rates of the three original image datacorresponding to the extracted three points. However, the presentinvention is not limited to this. The control section 410 may determinecombination rates concerning five original image data respectivelycorresponding to all the points PA to PE and combine the five originalimage data on the basis of the determined combination rates.

Note that, on the observation screen 430A shown in FIG. 12, acombination-rate input field in which combination rates concerning aplurality of original image data obtained by the plural illuminationimaging can be input by the operation section 440 shown in FIG. 1 may bedisplayed. In this case, the control section 410 may combine a part orall of the plurality of original image data on the basis of values inputto the combination-rate input field by the user.

On the observation screen 430A shown in FIG. 12, the light icon ss1 issuperimposed and displayed on the target position image ss0 displayed inthe sub-display region 433. In this embodiment, in addition to the lighticon ss1 on the target position image ss0, the light icon ss1 may alsobe superimposed and displayed on the image SI displayed in the maindisplay region 432. FIG. 14 is a diagram showing an example in which thelight icons ss1 are respectively displayed in the main display region432 and the sub-display region 433.

In this case, the points PA to PE are set on the image SI of theobservation target S as well. The user can move, on the observationscreen 430A, one of the light icon ss1 on the image SI of theobservation target S and the light icon ss1 on the target position imagess0, for example, using the operation section 440 shown in FIG. 1.

When the light icon ss1 on the target position image ss0 is moved, thecontrol section 410 generates image data for display in a procedure sameas the procedure in the example explained with reference to FIGS. 13A to13C above and displays the image SI based on the generated image datafor display in the main display region 432 . At this point, the controlsection 410 adjusts the position of the light icon ss1 on the image SIto move the light icon ss1 to a position corresponding to the positionof the light icon ss1 on the target position image ss0.

When the light icon ss1 on the image SI of the observation target S ismoved, the control section 410 generates image data for display on thebasis of a positional relation between the position of the light iconss1 on the image SI and the points PA to PE set in the image SI anddisplays the image SI based on the generated image data for display inthe main display region 432. At this point, the control section 410adjusts the position of the light icon ss1 on the target position imagess0 to move the light icon ss1 to a position corresponding to theposition of the light icon ss1 on the image SI.

According to the example shown in FIG. 14, the user can designate animaginary emitting direction of light using a desired light icon ss1 ofthe two light icons ss1. Note that, in the example shown in FIG. 14, thetwo light icons ss1 do not always have to be simultaneously displayed.For example, when the various buttons, the light icon ss1, and the likedisplayed on the observation screen 430A are operated by a pointer, onlyone light icon ss1 of the two light icons ss1 may be displayed on theobservation screen 430A according to the position of the pointer on theobservation screen 430A. Specifically, when a mouse pointer is locatedon the main display region 432, only the light icon ss1 on the image SIof the observation target S may be displayed. The light icon ss1 on thetarget position image ss0 does not have to be displayed. When the mousepointer is located on the sub-display region 433, only the light iconss1 on the target position image ss0 may be displayed. The light iconss1 on the image SI of the observation target S does not have to bedisplayed.

Note that the light icon ss1 on the target position image ss0 may bedisplayed irrespective of the position of the mouse pointer.Consequently, the user can easily grasp an imaginary emitting positionof light.

A specific example is explained concerning a change in the observationscreen 430A at the time when an imaginary emitting direction of light isdesignated by the light icon ss1 in a state in which the observationscreen 430A shown in FIG. 12 is displayed on the display section 430.

FIG. 15 is a diagram showing another display example of the observationscreen 430A. In FIG. 15, in order to facilitate understanding of thefollowing explanation, the five points PA to PE shown in FIG. 13A areshown on the target position image ss0 displayed in theemitting-direction designation field 433 a.

As indicated by a dotted line in the emitting-direction designationfield 433 a shown in FIG. 15, for example, the light icon ss1 is movedfrom the position of the point PB to the position between the points PBand PE on a concentric circle centering on the point PA on which thepoints PB to PE are arranged. In this case, the control section 410generates image data for display by combining a part of the plurality oforiginal image data respectively corresponding to the points PA to PE asin the example explained above. The control section 410 causes thedisplay section 430 to display, in the main display region 432, theimage SI of the observation target S based on the generated image datafor display.

In the image SI displayed in the main display region 432 shown in FIG.15, the uneven portion in the observation target S is stronglyemphasized in an imaginary emitting direction of light designated by thelight icon ss1 in the emitting-direction designation field 433 a.

The imaginary emitting direction of light includes components of anazimuth angle and an angle of elevation. In this example, the light iconss1 is moved on the concentric circle centering on the point PA on whichthe points PB to PE are arranged. The user can designate an azimuthangle of the imaginary emitting direction of light by moving the lighticon ss1 on the target position image ss0 to rotate with respect to thecenter of the target position image ss0. Consequently, the azimuth angleof the imaginary emitting direction of light is changed to the azimuthangle designated by the light icon ss1. In this way, the user candesignate the azimuth angle of the imaginary emitting direction of lightin a desired direction by operating the light icon ss1. As a result, inthe image SI displayed in the main display region 432, the user caneasily change a direction in which the uneven portion in the observationtarget S is emphasized to the θ direction.

FIG. 16 is a diagram showing still another display example of theobservation screen 430A. In FIG. 16, as in the example shown in FIG. 15,the five points PA to PE shown in FIG. 13A are shown on the targetposition image ss0 displayed in the emitting-direction designation field433 a. As indicated by a dotted line in the emitting-directiondesignation field 433 a shown in FIG. 16, the light icon ss1 is moved tobe closer to the point PA from the position shown in theemitting-direction designation field 433 a shown in FIG. 15. In thiscase, the control section 410 generates image data for display bycombining a part of the plurality of original image data respectivelycorresponding to the points PA to PE as in the example explained above.The control section 410 causes the display section 430 to display, inthe main display region 432, the image SI of the observation target Sbased on the generated image data for display.

In the image SI displayed in the main display region 432 shown in FIG.16, the uneven portion in the observation target S is weakly emphasizedcompared with the image SI displayed in the main display region 432shown in FIG. 15.

In this example, the light icon ss1 is moved from the concentric circleon which the points PB to PE are arranged centering on the point PAtoward the point PA. The user can designate an angle of elevation of theimaginary emitting direction of light from the placement surface bymoving the light icon ss1 close to or away from the center of the targetposition image ss0 on the target position image ss0. Consequently, theangle of elevation of the imaginary emitting direction of light from theplacement surface is changed to the angle of elevation designated by thelight icon ss1. In this way, the user can designate the angle ofelevation of the imaginary emitting direction of light in a desiredangle by operating the light icon ss1. As a result, in the image SIdisplayed in the main display region 432, the user can easily change adegree of the emphasis of the uneven portion in the observation targetS.

In the example explained above, on the observation screen 430A of thedisplay section 430, the main display region 432 for displaying theimage SI based on the image data for display and the sub-display region433 for operating the light icon ss1 are set. Consequently, the image SIof the observation target S and the light icon ss1 do not overlap.Therefore, it is easy to visually recognize the image SI of theobservation target S and the light icon ss1.

The user operates the saving button b7 shown in FIG. 12 using theoperation section 440 shown in FIG. 1 in a state in which the imaginaryemitting direction of light is designated in the desired directionconcerning the image SI of the observation target S. In this case, theimage data for display of the image SI displayed in the main displayregion 432 is stored in the storing section 420 together with aplurality of data concerning the image data for display. The pluralityof data include a plurality of original image data related to the imagedata for display, imaging information, illumination information, andlens information.

In the example explained above, one of the plurality of images SI basedon the plurality of original image data generated by the immediatelypreceding plural illumination imaging is displayed in the main displayregion 432 of the observation screen 430A in the initial state after thecompletion of the plural illumination imaging. However, the presentinvention is not limited to this. In the magnifying observationapparatus 1, for example, before the plural illumination imaging isstarted, an imaginary emitting direction of light corresponding to theimage SI that should be displayed in the initial state in advance may beable to be designated. Alternatively, the imaginary emitting directionof light corresponding to the image SI that should be displayed in theinitial state in advance may be designated by a manufacturer in advanceduring factory shipment of the magnifying observation apparatus 1. Animage (a moving image) in which an emitting direction with respect tothe image SI smoothly changes such that the imaginary emitting directionof light corresponding to the image SI changes maybe displayed in themain display region 432 of the observation screen 430A in the initialstate after the completion of the plural illumination imaging untiloperation by the user is received.

In this case, the control section 410 generates, when the pluralillumination imaging is completed, image data for display correspondingto an emitting direction designated on the basis of the imaginaryemitting direction of light designated in advance and the plurality oforiginal image data generated by the plural illumination imaging. Thecontrol section 410 causes the display section 430 to display, in themain display region 432, the image SI based on the generated image datafor display.

(b) Example of Plural Illumination Imaging Processing

The system program stored in the storing section 420 shown in FIG. 2includes a plural illumination imaging program and an image-for-displaygenerating program. The control section 410 shown in FIG. 2 performsplural illumination imaging processing and image-for-display generationprocessing by executing the plural illumination imaging program and theimage-for-display generating program. The series of basic operationexplained above is realized by the plural illumination imagingprocessing and the image-for-display generation processing.Consequently, even if the user is unskilled, the user can easilygenerate original image data.

FIG. 17 is a flowchart for explaining an example of the pluralillumination imaging processing. The plural illumination imagingprocessing is started in response to an instruction for the pluralillumination imaging by the user. When the plural illumination imagingprocessing is started, the control section 410 irradiates the ringillumination on the observation target S according to imaging conditionsset in advance and images the observation target S with the imagingsection 132 (step S101). Original image data generated by the imaging isstored in the storing section 420.

Subsequently, the control section 410 sets i to 1 (step S102). In thisstep, i indicates numbers of a plurality of directional illuminations.Subsequently, the control section 410 irradiates i-th directionalillumination on the observation target S and images the observationtarget S with the imaging section 132 (step S103). Original image dataobtained by the imaging is stored in the storing section 420.

Subsequently, the control section 410 determines whether i is 4 (stepS104). If i is not 4, the control section 410 updates i to i+1 (stepS105) and returns to the processing in step S103.

If i is 4 in step S104, the control section 410 generates a plurality ofthumbnail image data respectively corresponding to a plurality oforiginal image data (step S106). The generated plurality of thumbnailimage data are stored in the storing section 420. Consequently, theplural illumination imaging processing ends.

In the above explanation, the processing in step S106 may be omittedwhen it is unnecessary to display a thumbnail image on the displaysection 430. Consequently, a processing time is reduced.

In the above explanation, a part of the processing may be performed atother points in time. For example, the processing in step S101 may beexecuted later than the processing in steps S102 to S105.

(c) Example of the Image-For-Display Generation Processing

FIGS. 18 and 19 are flowcharts for explaining an example of theimage-for-display generation processing. In this embodiment, the controlsection 410 starts the image-for-display generation processing after theend of the plural illumination imaging processing.

First, the control section 410 causes the display section 430 todisplay, in the main display region 432, the image SI of the observationtarget S based on any original image data among the plurality oforiginal image data generated by the plural illumination imagingprocessing (step S201). The control section 410 causes the displaysection 430 to display the target position image ss0 and the light iconss1 in the emitting-direction designation field 433 a (step S202).Further, the control section 410 causes the display section 430 todisplay the reference point image ss2, the hemispherical image ss3, andthe emitting position image ss4 in the emitting-direction display field433 b (step S203).

Thereafter, the control section 410 determines whether the light iconss1 is operated (step S204). If the light icon ss1 is not operated, thecontrol section 410 proceeds to processing in step S210 explained below.

If the light icon ss1 is operated, the control section 410 updates thedisplay of the light icon ss1 and the emitting position image ss4 inresponse to the operation of the light icon ss1 (step S205). The controlsection 410 recognizes that an imaginary emitting direction of light isdesignated by the operation of the light icon ss1 (step S206) anddetermines whether the designated emitting direction is the ringemitting direction or anyone of the first to fourth emitting directions(step S207). The determination processing in step S207 is executed onthe basis of a positional relation between the points PA to PE set onthe target position image ss0 and the light icon ss1.

If the designated emitting direction is the ring emitting direction orany one of the first to fourth emitting directions, the control section410 sets the original image data corresponding to the designatedemitting direction as image data for display and causes the displaysection 430 to display the image SI of the observation target S based onthe image data for display in the main display region 432 (step S208).Thereafter, the control section 410 proceeds to processing in step S210explained below.

If the designated emitting direction is not the ring emitting directionor all of the first to fourth emitting directions in step S207, thecontrol section 410 calculates combination rates of the plurality oforiginal image data on the basis of the designated emitting direction(step S209). Like the processing in step S207, the calculationprocessing in step S209 is executed on the basis of the positionalrelation between the points PA to PE set on the target position imagess0 and the light icon ss1.

Thereafter, the control section 410 generates image data for display bycombining the plurality of original image data on the basis of thecombination rates calculated in step S209 and causes the display section430 to display the image SI of the observation target S based on theimage data for display in the main display region 432 (step S210).

In this embodiment, the user can instruct an end of the observation ofthe observation target S by operating the operation section 440 shown inFIG. 1. After the processing in step S209, the control section 410determines whether the end of the observation of the observation targetS is instructed (step S211). If the end of the observation of theobservation target S is instructed, the control section 410 ends theimage-for-display generation processing. On the other hand, if the endof the observation of the observation target S is not instructed, thecontrol section 410 returns to the processing in step S204.

In the image-for-display generation processing shown in FIGS. 18 and 19,during or after the processing in step S209, the control section 410 maycalculate at least one of an azimuth angle and an angle of elevation ofthe designated imaginary emitting direction of light. In this case, thecontrol section 410 may cause the display section 430 to display thecalculated at least one of the azimuth angle and the angle of elevation.Consequently, the user can easily recognize information concerning thedesignated imaginary emitting direction of light.

In the image-for-display generation processing explained above, theimage SI of the observation target S based on any original image dataamong the plurality of original image data generated in the pluralillumination imaging processing is displayed on the display section 430in the processing in step S201. However, the present invention is notlimited to this. In the processing in step S201, the control section 410may cause the display section 430 to display the image SI based onoriginal image data corresponding to illumination decided in advance(e.g., the ring illumination) instead of the any original image data.Alternatively, the control section 410 may omit the processing in stepS201.

In the example explained above, the image-for-display generationprocessing is executed after the end of the plural illumination imagingprocessing. However, the present invention is not limited to this. Whenthe plural illumination imaging processing is continuously orintermittently executed at a fixed cycle, the image-for-displaygeneration processing maybe executed in parallel to the pluralillumination imaging processing. In this case, the image-for-displaygeneration processing can be executed on the basis of a latest pluralityof original image data stored in the storing section 420 by theimmediately preceding plural illumination imaging processing.

n the magnifying observation apparatus 1 according to this embodiment,the user can designate, using the operation section 440 shown in FIG. 1,apart of the plurality of original image data stored in the storingsection 420. In this case, the control section 410 may respond to thedesignation of the original image data by the user, read the designatedoriginal image data, and perform the image-for-display generationprocessing based on the read original image data.

(3) Depth Synthesis Processing (a) Processing Content

The user can give an instruction for the depth synthesis processing tothe control section 410 shown in FIG. 1 by operating the depth synthesisbutton b1 shown in FIG. 12 using the operation section 440 shown in FIG.1.

In the depth synthesis processing, it is desirable that a range of afocal position of light and a moving pitch of the focal position in theZ direction are set in advance as imaging conditions for the depthsynthesis processing. In this case, the focus driving section 113 shownin FIG. 1 does not need to change the focal position of the light in anexcessively large range. Therefore, it is possible to generate aplurality of original image data at high speed. The imaging conditionsare set, for example, on the basis of operation of the operation section440 by the user. Note that the range of the focal position of the lightand the moving pitch of the focal position in the Z direction may beautomatically set according to, for example, magnification of theobjective lens 131 a used for imaging. In the following explanation, itis assumed that imaging conditions for the depth synthesis processingare set in advance.

FIGS. 20A and 20B are conceptual diagrams of the depth synthesisprocessing. In FIG. 20A, a positional relation among the lens unit 131,the light projecting section 140, and the stage 121 is shown. In thisexample, in a state in which the stage 121 stands still, the lens unit131 is moved in the Z direction integrally with the light projectingsection 140. In this case, positions H1 to Hj (j is a natural number) inthe Z direction to which the lens unit 131 (the objective lens 131 a)should move are decided on the basis of the range of the focal positionof the light and the moving pitch of the focal position in the Zdirection designated in advance.

In the depth synthesis processing, the observation target S is imagedusing the ring illumination and the first to fourth directionalilluminations in a state in which the lens unit 131 is positioned ineach of the positions H1 to Hj. Consequently, pluralities of (j)original image data respectively corresponding to the positions H1 to Hjare generated using the ring illumination and the first to fourthdirectional illuminations. In FIG. 20B, pluralities of images SI of theobservation target S respectively corresponding to the positions H1 toHj are shown for each of the illuminations.

A focus degree of each of pixels is determined concerning each of theplurality of original image data obtained by the imaging using the ringillumination. The plurality of original image data are selectivelycombined on the basis of a determination result of the focus degree.Consequently, depth synthesis image data focused on all portions of theobservation target S on which the ring illumination is irradiated isgenerated. Depth synthesis image data corresponding to the directionalilluminations are generated on the basis of the pluralities of originalimage data corresponding to the directional illuminations and mask imagedata explained below. An image based on the depth synthesis image datais referred to as depth synthesis image. In FIG. 20B, a plurality ofdepth synthesis images SF of the observation target S respectivelycorresponding to the ring illumination and the first to fourthdirectional illuminations are shown.

The control section 410 executes the image-for-display generationprocessing on the basis of a plurality of depth synthesis image datagenerated by the depth synthesis processing instead of the plurality oforiginal image data. Consequently, the user can easily cause the displaysection 430 to display a depth synthesis image SF of the observationtarget S that should be obtained when it is assumed that light isirradiated on the observation target S from a desired direction.

In the depth synthesis processing explained above, pluralities oforiginal image data respectively corresponding to the positions H1 to Hjare generated for each of the illuminations. An operation button fordesignating only the generation of the pluralities of original imagedata may be displayed on the observation screen 430A shown in FIG. 12.When only the generation of the pluralities of original image data isdesignated, after performing only the generation of the pluralities oforiginal image data, the control section 410 may receive designation bythe user concerning a position in the Z direction of a focus and executethe image-for-display generation processing using a plurality oforiginal image data corresponding to the designated position in the Zdirection.

In the depth synthesis processing, mask image data is generated whendepth synthesis image data corresponding to the ring illumination isgenerated. A plurality of depth synthesis image data respectivelycorresponding to the first to fourth directional illuminations aregenerated using the generated mask image data. The mask image data isexplained.

Numbers corresponding to the focal positions H1 to Hj of light in the Zdirection are given to respective pluralities of original image datagenerated in processing for imaging the observation target S whilechanging the positions in the Z direction of the lens barrel section 130and the stage 121. The data generating section 610 shown in FIG. 9generates mask image data indicating a corresponding relation betweenpixels of the depth synthesis image data corresponding to the ringillumination and numbers of the original image data.

FIG. 21 is a schematic diagram visually showing the mask image data.Small squares in FIG. 21 are equivalent to pixel data of the depthsynthesis image data corresponding to the ring illumination. Numbersgiven to the squares indicate numbers of original image data from whichdata are extracted that indicate a pixel value of pixel data generatedin which position among the focal positions H1 to Hj of the light in theZ direction is optimum in pixels corresponding to the squares, that is,in which focal position of the light a brightness value is the highestwithout being saturated. That is, in an example shown in FIG. 21, it isindicated that pixel data at the uppermost left is extracted fromoriginal image data in a focal position H12 of the light and pixel dataat the lowermost right is extracted from original image data in a focalposition H85 of the light.

The data generating section 610 generates, on the basis of the generatedmask image data, depth synthesis image data corresponding to therespective first to fourth directional illuminations. In this case, thefocus determining section 620 shown in FIG. 9 does not need to determinea focus degree of each of pixels concerning the original image data whengenerating the depth synthesis image data corresponding to therespective first to fourth directional illuminations. Consequently, itis possible to increase the speed of the depth synthesis processing.

In the above explanation, the depth synthesis image data is generatedfirst for each of the ring illumination and the first to fourthdirectional illuminations. The image data for display is generated onthe basis of the generated plurality of depth synthesis image data.However, the present invention is not limited to this. Pluralities ofimage data for display respectively corresponding to the plurality ofpositions H1 to Hj in the Z direction may be generated on the basis ofthe imaginary emitting direction of light designated by the user. Depthsynthesis image data for display may be generated on the basis of thegenerated pluralities of image data for display. In this case, the maskimage data is unnecessary.

Note that, in the above explanation, the mask image data is generated onthe basis of the image data at the time when the ring illumination isemitted. However, the present invention is not limited to this. The maskimage data may be generated on the basis of each of image data at thetime when the ring illumination is emitted and image data at the timewhen the directional illumination is emitted. The mask image data at thetime when the directional illumination is emitted may be generated foreach of the plurality of directional illuminations. This configurationis useful when an optimum position in the Z direction is differentbecause, for example, light amounts are different in the ringillumination and the directional illumination.

(b) Example of the Depth Synthesis Processing

The system program stored in the storing section 420 shown in FIG. 2includes a depth synthesis program. The control section 410 shown inFIG. 2 performs the depth synthesis processing by executing the depthsynthesis program.

FIGS. 22, 23, and 24 are flowcharts for explaining an example of thedepth synthesis processing. The control section 410 moves the lens unit131 to a lower limit position (step S301). Subsequently, the controlsection 410 irradiates the ring illumination on the observation target Swith the light projecting section 140 and images the observation targetS with the imaging section 132 (step S302). The control section 410gives a number corresponding to the position in the Z direction of thelens unit 131 to generated original image data (step S303).Subsequently, the control section 410 determines whether the lens unit131 has moved to an upper limit position (step S304).

If the lens unit 131 has not moved to the upper limit position in stepS304, the control section 410 moves the lens unit 131 upward by apredetermined amount (a moving pitch set in advance) (step S305).Thereafter, the control section 410 returns to the processing in stepS302. The control section 410 repeats the processing insteps S302 toS305 until the lens unit 131 moves to the upper limit position.

If the lens unit 131 has moved to the upper limit position instep S304,the control section 410 determines a focus degree of each of pixelsconcerning original image data corresponding to the ring illumination(step S306). Subsequently, the control section 410 generates depthsynthesis image data corresponding to the ring illumination by combiningpixel data of a plurality of original image data on the basis of adetermination result of the focus degree (step S307). The controlsection 410 generates mask image data indicating a correspondencerelation between pixels of combined image data and numbers of theoriginal image data and causes the storing section 420 to store the maskimage data (step S308).

Thereafter, the control section 410 moves the lens unit 131 to the lowerlimit position (step S309). Subsequently, the control section 410 sets ito 1 (step S310). In this step, i indicates numbers of a plurality ofdirectional illuminations. Subsequently, the control section 410irradiates the i-th directional illumination on the observation target Swith the light projecting section 140 and images the observation targetS with the imaging section 132 (step S311). The control section 410gives a number corresponding to the position in the Z direction of thelens unit 131 to the generated original image data (step S312).Subsequently, the control section 410 determines whether the lens unit131 has moved to the upper limit position (step S313).

If the lens unit 131 has not moved to the upper limit position in stepS313, the control section 410 moves the lens unit 131 upward by apredetermined amount (a moving pitch set in advance) (step S314).Thereafter, the control section 410 returns to the processing in stepS311. The control section 410 repeats the processing insteps S311 toS314 until the lens unit 131 moves to the upper limit position.

If the lens unit 131 has moved to the upper limit position in step S313,the control section 410 generates depth synthesis image datacorresponding to the i-th directional illumination by combining pixeldata of the plurality of original image data on the basis of the maskimage data stored in the storing section 420 (step S315).

Subsequently, the control section 410 determines whether i is 4 (stepS316). If i is not 4 in step S316, the control section 410 updates i toi+1 (step S317). Thereafter, the control section 410 moves the lens unit131 to the lower limit position (step S318) and returns to theprocessing in step S311. The control section 410 repeats the processingin steps S311 to S318 until i reaches 4. Consequently, pluralities oforiginal image data corresponding to the respective first to fourthdirectional illuminations are generated. Depth synthesis image datacorresponding to the respective first to fourth directionalilluminations are generated. If i is 4 in step S316, the control section410 ends the processing.

In the above explanation, a part of the processing may be performed atanother point in time. For example, the processing in steps S306 to S308may be executed in parallel to steps S309 to S314. The processing instep S315 corresponding to the i-th directional illumination may beexecuted in parallel to steps S311 to S314 corresponding to (i+1)-thdirectional illumination. In these cases, it is possible to increase thespeed of the depth synthesis processing.

Alternatively, the processing in steps S306 to S308 may be executedlater than the processing in steps S309 to S314. The processing in stepS315 corresponding to the i-th directional illumination may be executedlater than the processing insteps S311 to S314 corresponding to the(i+1) -th directional illumination.

(c) Another Example of the Depth Synthesis Processing

FIGS. 25, 26, and 27 are flowcharts for explaining another example ofthe depth synthesis processing. The control section 410 moves the lensunit 131 to the lower limit position (step S321). Subsequently, thecontrol section 410 irradiates the ring illumination on the observationtarget S with the light projecting section 140 and images theobservation target S with the imaging section 132 (step S322). Thecontrol section 410 gives a number corresponding to the position in theZ direction of the lens unit 131 to generated original image data (stepS323).

Subsequently, the control section 410 sets i to 1 (step S324). In thisstep, i indicates numbers of a plurality of directional illuminations.Thereafter, the control section 410 irradiates the i-th directionalillumination on the observation target S with the light projectingsection 140 and images the observation target S with the imaging section132 (step S325). The control section 410 gives a number corresponding tothe position in the Z direction of the lens unit 131 to generatedoriginal image data (step S326). Subsequently, the control section 410determines whether i is 4 (step S327).

If i is not 4 in step S327, the control section 410 updates i to i+1(step S328). Thereafter, the control section 410 returns to theprocessing in step S325. The control section 410 repeats the processingin steps S325 to S328 until i reaches 4. Consequently, pluralities oforiginal image data corresponding to the respective first to fourthdirectional illuminations are generated. If i is 4 in step S327, thecontrol section 410 determines whether the lens unit 131 has moved tothe upper limit position (step S329).

If the lens unit 131 has not moved to the upper limit position in stepS329, the control section 410 moves the lens unit 131 upward by apredetermined amount (step S330).

Thereafter, the control section 410 returns to the processing in stepS322. The control section 410 repeats the processing in steps S322 toS330 until the lens unit 131 moves to the upper limit position.

If the lens unit 131 has moved to the upper limit position instep S329,the control section 410 determines a focus degree of each of pixelsconcerning the original image data corresponding to the ringillumination (step S331). Subsequently, the control section 410generates depth synthesis image data corresponding to the ringillumination by combining pixel data of the plurality of original imagedata on the basis of a determination result of the focus degree (stepS332). The control section 410 generates mask image data indicating acorrespondence relation between pixels of combined image data andnumbers of the original image data and causes the storing section 420 tostore the mask image data (step S333).

Subsequently, the control section 410 sets i to 1 again (step S334).Thereafter, the control section 410 generates depth synthesis image datacorresponding to the i-th directional illumination by combining thepixel data of the plurality of original image data on the basis of themask image data stored in the storing section 420 (step S335).

Subsequently, the control section 410 determines whether i is 4 (stepS336). If i is not 4 in step S316, the control section 410 updates i toi+1 (step S337). Thereafter, the control section 410 returns to theprocessing in step S335. The control section 410 repeats the processingin steps S335 to S337 until i reaches 4. Consequently, depth synthesisimage data corresponding to the respective first to fourth directionalilluminations are generated. If i is 4 in step S336, the control section410 ends the processing.

In the above explanation, a part of the processing may be performed atanother point in time. For example, a part of the processing in stepsS331 to S337 may be executed in parallel to steps S321 to S330. In thiscase, it is possible to increase the speed of the depth synthesisprocessing. The processing in steps S322 and S323 may be executed laterthan the processing in steps S324 to S328.

In the example and the other example of the depth synthesis processing,the lens unit 131 is moved upward to the upper limit position by thepredetermined amount at a time after being moved to the lower limitposition serving as the initial position. However, the present inventionis not limited to this. In the depth synthesis processing, the lens unit131 may be moved downward to the lower limit position by thepredetermined amount at a time after being moved to the upper limitposition serving as the initial position.

Note that, in the above explanation, the pluralities of original imagedata respectively corresponding to the positions H1 to Hj are combinedin the depth synthesis processing. However, the present invention is notlimited to this. The pluralities of original image data respectivelycorresponding to the positions H1 to Hj may be independently usedwithout being combined.

For example, original image data in which a focus of the imaging section132 coincides with a specific portion of the observation target S mostmay be extracted from the pluralities of original image datarespectively corresponding to the positions H1 to Hj on the basis of thedetermination result by the focus determining section 620 shown in FIG.9. In this case, it is possible to generate, at high speed, image datafor display indicating an image having a large focus degree as a wholeon the basis of the plurality of original image data respectivelyextracted according to the ring illumination and the first to fourthdirectional illuminations.

(4) DR Adjustment Processing (a) Processing Content

The user can give an instruction for the DR adjustment processing to thearithmetic processing section 600 by operating the DR adjustment buttonb2 shown in FIG. 12 using the operation section 440 shown in FIG. 1.

In the DR adjustment processing, in a state in which the light receptiontime of the imaging section 132 is changed to a plurality of valuesdecided in advance, the observation target S at the time when the ringillumination and the first to fourth directional illuminations arerespectively irradiated is imaged. Consequently, a plurality of originalimage data respectively corresponding to the ring illumination and thefirst to fourth directional illuminations are generated by the datagenerating section 610 shown in FIG. 9 in every light reception time ofthe imaging section 132. An overall pixel value of the original imagedata generated when the light reception time of the imaging section 132is short is relatively small. An overall pixel value of the originalimage data generated when the light reception time of the imagingsection 132 is long is relatively large.

The plurality of original image data corresponding to the ringillumination are combined by the data generating section 610.Consequently, it is possible to adjust a dynamic range of the originalimage data corresponding to the ring illumination. Similarly, thepluralities of original image data corresponding to the directionalilluminations are combined by the data generating section 610.Consequently, it is possible to adjust a dynamic range of the originalimage data corresponding to the directional illuminations.

The adjustment of the dynamic range includes expansion and reduction ofthe dynamic range. It is possible to reduce black solid and halation(white void) in an image by combining the pluralities of original imagedata to expand the dynamic range. On the other hand, a difference inlight and shade of an image is increased by combining the pluralities oforiginal image data to reduce the dynamic range. Consequently, it ispossible to precisely observe unevenness of the observation target Shaving a smooth surface.

In the above explanation, the original image data are combined firstsuch that the dynamic range is adjusted for each of the ringillumination and the first to fourth directional illuminations. Theimage data for display is generated on the basis of the combinedpluralities of original image data. However, the present invention isnot limited to this. The image data for display may be generated firston the basis of the pluralities of original image data in every lightreception time of the imaging section 132. The image data for displaygenerated in every light reception time of the imaging section 132 maybe combined such that the dynamic range is adjusted.

(b) Example of the DR Adjustment Processing

The system program stored in the storing section 420 shown in FIG. 2includes a DR adjustment program. The control section 410 shown in FIG.2 performs the DR adjustment processing by executing the DR adjustmentprogram.

FIGS. 28 and 29 are flowcharts for explaining an example of the DRadjustment processing. The control section 410 sets the light receptiontime of the imaging section 132 to an initial value decided in advance(step S401). In this state, the control section 410 irradiates the ringillumination on the observation target S with the light projectingsection 140 and images the observation target S with the imaging section132 (step S402). Subsequently, the control section 410 determineswhether the observation target S has been imaged in all of desired lightreception times of the imaging section 132 in a state in which the ringillumination is irradiated (step S403).

If the observation target S has been imaged in not all of the desiredlight reception times of the imaging section 132 in step S403, thecontrol section 410 sets the light reception time of the imaging section132 to the next value decided in advance (step S404). Thereafter, thecontrol section 410 returns to the processing in step S402 . The controlsection 410 repeats the processing in steps S402 to S404 until theobservation target S is imaged in all of the desired light receptiontimes of the imaging section 132.

If the observation target S has been imaged in all of the desired lightreception times of the imaging section 132 in step S403, the controlsection 410 combines a generated plurality of original image datacorresponding to the ring illumination (step S405). Consequently, adynamic range of the original image data corresponding to the ringillumination is adjusted.

Thereafter, the control section 410 sets i to 1 (step S406). In thisstep, i indicates numbers of a plurality of directional illuminations.Subsequently, the control section 410 sets the light reception time ofthe imaging section 132 to an initial value decided in advance (stepS407). In this state, the control section 410 irradiates the i-thdirectional illumination on the observation target S with the lightprojecting section 140 and images the observation target S with theimaging section 132 (step S408). Subsequently, the control section 410determines whether the observation target S has been imaged in all ofthe desired light reception times of the imaging section 132 in a statein which the i-th directional illumination is irradiated (step S409).

If the observation target S has been imaged in not all of the desiredlight reception times of the imaging section 132 in step S409, thecontrol section 410 sets the light reception time of the imaging section132 to the next value decided in advance (step S410). Thereafter, thecontrol section 410 returns to the processing in step S408. The controlsection 410 repeats the processing in steps S408 to S410 until theobservation target S is imaged in all of the desired light receptiontimes of the imaging section 132.

If the observation target S has been imaged in all of the desired lightreception times of the imaging section 132 in step S409, the controlsection 410 combines a generated plurality of original image datacorresponding to the i-th directional illumination (step S411).Consequently, a dynamic range of the original image data correspondingto the i-th directional illumination is adjusted.

Subsequently, the control section 410 determines whether i is 4 (stepS412). If i is not 4 in step S412, the control section 410 updates i toi+1 (step S413). Thereafter, the control section 410 returns to theprocessing in step S407. The control section 410 repeats the processingin steps S407 to S413 until i reaches 4. Consequently, pluralities oforiginal image data corresponding to the respective first to fourthdirectional illuminations are generated and combined to adjust a dynamicrange. If i is 4 in step S412, the control section 410 ends theprocessing.

In the above explanation, a part of the processing may be performed atanother point in time. For example, the processing in step S405 may beexecuted in parallel to the processing insteps S406 to S413. Theprocessing in step S411 corresponding to the i-th directionalillumination may be executed in parallel to steps S407 to S410corresponding to the (i+1)-th directional illumination. In these cases,it is possible to increase the speed of the DR adjustment processing.

Alternatively, the processing in steps S401 to S405 may be executedlater than the processing in steps S406 to S413. The processing in stepS411 corresponding to the i-th directional illumination may be executedlater than the processing insteps S407 to S410 corresponding to the(i+1) -th directional illumination.

(c) Another Example of the DR Adjustment Processing.

FIGS. 30 and 31 are flowcharts for explaining another example of the DRadjustment processing. The control section 410 sets the light receptiontime of the imaging section 132 to an initial value decided in advance(step S421). In this state, the control section 410 irradiates the ringillumination on the observation target S with the light projectingsection 140 and images the observation target S with the imaging section132 (step S422).

Subsequently, the control section 410 sets i to 1 (step S423). In thisstep, i indicates numbers of a plurality of directional illuminations.Thereafter, the control section 410 irradiates the i-th directionalillumination on the observation target S with the light projectingsection 140 and images the observation target S with the imaging section132 (step S424).

Subsequently, the control section 410 determines whether i is 4 (stepS425). If i is not 4 in step S425, the control section 410 updates i toi+1 (step S426). Thereafter, the control section 410 returns to theprocessing in step S424. The control section 410 repeats the processingin steps S424 to S426 until i reaches 4. Consequently, pluralities oforiginal image data corresponding to the respective first to fourthdirectional illuminations are generated. Subsequently, the controlsection 410 determines whether the observation target S has been imagedin all of the desired light reception times of the imaging section 132(step S427).

If the observation target S has been imaged in not all of the desiredlight reception times of the imaging section 132 in step S427, thecontrol section 410 sets the light reception time of the imaging section132 to the next value decided in advance (step S428). Thereafter, thecontrol section 410 returns to the processing in step S422. The controlsection 410 repeats the processing in steps S422 to S428 until theobservation target S is imaged in all of the desired light receptiontime of the imaging section 132.

If the observation target S has been imaged in all of the desired lightreception times of the imaging section 132 in step S427, the controlsection 410 combines a generated plurality of original image datacorresponding to the ring illumination to adjust a dynamic range (stepS429). Consequently, a dynamic range of the original image datacorresponding to the ring illumination is adjusted.

Thereafter, the control section 410 sets i to 1 again (step S430).Subsequently, the control section 410 combines a generated plurality oforiginal image data corresponding to the i-th directional illumination(step S431). Consequently, a dynamic range of the original image datacorresponding to the i-th directional illumination is adjusted.Subsequently, the control section 410 determines whether i is 4 (stepS432).

If i is not 4 in step S432, the control section 410 updates i to i+1(step S433). Thereafter, the control section 410 returns to theprocessing in step S431. The control section 410 repeats the processingin steps S431 to S433 until i reaches 4. Consequently, the pluralitiesof original image data corresponding to the respective first to fourthdirectional illuminations are combined to adjust a dynamic range. If iis 4 in step S432, the control section 410 ends the processing.

In the above explanation, a part of the processing may be performed atanother point in time. For example, a part of the processing in stepsS429 to S433 may be performed in parallel to the processing in stepsS421 to S428. In this case, it is possible to increase the speed of theDR adjustment processing. The processing in step S422 may be executedlater than the processing in steps S423 to S426. Further, the processingin step S429 may be executed later than the processing in steps S430 toS433.

(5) Effect

In the magnifying observation apparatus 1 according to this embodiment,the light emitting section 140 o of the light projecting section 140surrounds the optical axis A1 of the objective lens 131 a. The opticalaxis A2 of the light projecting section 140 is substantially the same asthe optical axis A1 of the objective lens 131 a. Therefore, the lightprojecting section 140 is capable of irradiating the ring illuminationin a uniform direction on the observation target S from the regions 140Ato 140D. The light projecting section 140 is capable of irradiating thedirectional illumination in an emitting direction different from theemitting direction of the ring illumination on the observation target Sfrom a part of the regions 140A to 140D.

Therefore, by optionally designating the emitting directions, the usercan generate, without changing an emitting direction of light actuallyirradiated on the observation target S, image data for displayindicating an image at the time when light in an appropriate emittingdirection corresponding to the shape and the material of the observationtarget S is irradiated on the observation target S. Consequently, it ispossible to easily acquire an image of the observation target Scorresponding to a request of the user.

The image data for display can be generated using original image datacorresponding to the already generated ring illumination or directionalillumination. Therefore, it is unnecessary to perform the imaging of theobservation target S again. Therefore, it is possible to reduce a burdenon the user.

[2] Second Embodiment

Concerning a magnifying observation apparatus according to a secondembodiment of the present invention, differences from the magnifyingobservation apparatus 1 according to the first embodiment are explained.FIG. 32 is a schematic diagram showing the configuration of themagnifying observation apparatus according to the second embodiment ofthe present invention. As shown in FIG. 32, in the magnifyingobservation apparatus 1 according to this embodiment, the measurementhead 100 further includes a light projecting section 160. The lightprojecting section 160 includes a half mirror 161.

The lens unit 131 is configured to be capable of holding the lightprojecting section 160 on the inside. The light projecting section 160is disposed in the lens unit 131 in a state in which the lightprojecting section 160 is inclined at approximately 45° with respect tothe optical axis A1 of the objective lens 131 a such that a reflectionsurface of the half mirror 161 faces obliquely downward. The lightprojecting section 160 is optically connected to the light generatingsection 300 of the processing device 200 by a part of not-shown opticalfibers of the fiber unit 201.

The light blocking section 320 of the light generating section 300includes a plurality of opening patterns respectively corresponding tothe regions 140A to 140D of the light projecting section 140 shown inFIGS. 3A and 3B and includes an opening pattern corresponding to thelight projecting section 160. The light-projection control section 510shown in FIG. 2 is capable of making light incident on the lightprojecting section 140 as in the first embodiment by switching theopening pattern of the light blocking section 320 that causes the lightto pass. The light-projection control section 510 is also capable ofmaking the light incident on the light projecting section 160. Behaviorof the light made incident on the light projecting section 140 is thesame as behavior of the light made incident on the light projectingsection 140 in the first embodiment.

The light made incident on the light projecting section 160 is reflectedby the half mirror 161 to be emitted downward along the optical axis A1of the objective lens 131 a and irradiated on the observation target S.The light emitted from the light projecting section 160 is referred toas coaxial epi-illumination. The light irradiated on the observationtarget S is reflected upward, transmitted through the half mirror 161 ofthe light projecting section 160 and the lens unit 131, and guided tothe imaging section 132.

With the configuration explained above, the light projecting section 160is capable of irradiating the light on the observation target S from aposition closer to the optical axis A1 of the objective lens 131 a thanthe light projecting section 140. Therefore, the coaxialepi-illumination is bright field illumination emitted in a directionparallel to the optical axis A1 of the objective lens 131 a. The ringillumination is dark field illumination irradiated in a directioninclined with respect to the optical axis A1 of the objective lens 131a. By irradiating the coaxial epi-illumination on the observation targetS, it is possible to more clearly image unevenness on the surface of theobservation target S and a difference of a material. Note that it isalso possible to simultaneously irradiate lights on the observationtarget S from the light projecting sections 140 and 160.

The imaging control section 520 shown in FIG. 2 controls a lightreception time, a gain, timing, and the like of the imaging section 132during the irradiation of the coaxial epi-illumination. In thisembodiment, the irradiation of the coaxial epi-illumination is performedlater than the irradiation of the ring illumination and the first tofourth directional illuminations. The imaging control section 520performs automatic exposure on the basis of an average brightness valueof original image data corresponding to the ring illumination generatedearlier to thereby adjust the light reception time during theirradiation of the coaxial epi-illumination. The light reception timeduring the irradiation of the coaxial epi-illumination may be adjustedto a desired value by the user.

The imaging section 132 further generates original image data indicatingthe observation target S at the time when the coaxial epi-illuminationis irradiated on the observation target S. The generated original imagedata corresponding to the coaxial epi-illumination is stored in thestoring section 420. Imaging information further indicating presence orabsence of execution of the irradiation of the coaxial epi-illuminationand imaging conditions such as a light reception time during theirradiation of the coaxial epi-illumination is stored in the storingsection 420.

The data generating section 610 shown in FIG. 9 generates image data fordisplay further on the basis of the original image data corresponding tothe coaxial epi-illumination in addition to the original image datarespectively corresponding to the ring illumination and the directionalilluminations stored in the storing section 420. Specifically, the datagenerating section 610 combines, at rates decided by illuminationconditions designated by the user, a part or all of the plurality oforiginal image data respectively corresponding to the ring illumination,the directional illuminations, and the coaxial epi-illumination. Thegenerated image data for display is stored in the storing section 420.

In the plural illumination imaging processing according to thisembodiment, the observation target S is imaged using the coaxialepi-illumination after the imaging of the observation target S performedusing the ring illumination and the first to fourth directionalilluminations. Consequently, a plurality of (in this example, six)original image data respectively corresponding to the ring illumination,the first to fourth directional illuminations, and the coaxialepi-illumination are generated.

When the plural illumination imaging processing is completed, theobservation screen 430A is displayed on the display section 430. FIG. 33is a diagram showing a display example of the observation screen 430Aafter the plural illumination imaging processing according to the secondembodiment. As shown in FIG. 33, an epi-illumination button b11 isdisplayed in the function display region 431 in addition to theplurality of buttons b1 to b7 explained above.

The user operates the epi-illumination button b11 using the operationsection 440. Consequently, the user can instruct that image data fordisplay should be generated using the original image data correspondingto the coaxial epi-illumination.

When it is instructed that the original image data corresponding to thecoaxial epi-illumination is used, a bar 433 c and a slider 433 d fordesignating a combination rate of the original image data correspondingto the coaxial epi-illumination to the other original image data(hereinafter referred to as epi-illumination image rate) are displayedin the sub-display region 433.

The user can designate the epi-illumination image rate by operating theslider 433 d. In the example shown in FIG. 33, the epi-illuminationimage rate is designated higher as the slider 433 d is closer to theleft end of the bar 433 c. The epi-illumination image rate is designatedlower as the slider 433 d is closer to the right end of the bar 433 c.

When the epi-illumination image rate is designated, in the processing instep S209 in FIG. 19 in the image-for-display generation processing, thecontrol section 410 calculates combination rates of the plurality oforiginal image data on the basis of the designated epi-illuminationimage rate in addition to the designated emitting direction.

For example, first, the control section 410 calculates combination ratesof original image data respectively corresponding to the ringillumination and the first to fourth directional illuminations on thebasis of the designated emitting direction. Thereafter, the controlsection 410 corrects the combination rates of the original image datarespectively corresponding to the ring illumination and the first tofourth directional illuminations such that a total of a plurality ofcombination rates of the ring illumination and the first to fourthdirectional illuminations is (100-t) % when the designatedepi-illumination image rate is t (t is a number of 0 to 100)%.

The plurality of original image data are combined on the basis of theplurality of combination rates calculated as explained above, wherebyimage data for display is generated. The image SI of the observationtarget S including components of the original image data correspondingto the coaxial epi-illumination is displayed in the main display region432.

With the image SI of the original image data corresponding to thecoaxial epi-illumination, it is possible to accurately observe theunevenness on the surface of the observation target S and the differenceof the material compared with the image SI of the original image datarespectively corresponding to the ring illumination and the first tofourth directional illuminations.

Therefore, the user can easily acquire the image SI of the observationtarget S corresponding to a purpose of observation by operating theepi-illumination button b11 and the slider 433 d shown in FIG. 33.

[3] Third Embodiment

Concerning a magnifying observation apparatus according to a thirdembodiment of the present invention, differences from the magnifyingobservation apparatus 1 according to the first embodiment are explained.FIG. 34 is a schematic diagram showing the configuration of a magnifyingobservation apparatus according to a third embodiment of the presentinvention. As shown in FIG. 34, in the magnifying observation apparatus1 according to this embodiment, the measurement head 100 furtherincludes a light projecting section 170. The light projecting section170 includes a mirror 171. The magnifying observation apparatus 1further includes a fiber unit 204. The fiber unit 204 includes anot-shown plurality of optical fibers. The light projecting section 170may be incorporated in the setting section 111 of the stand section 110.

The setting section 111 of the stand section 110 is configured to becapable of holding the light projecting section 170 on the inside. Thelight projecting section 170 is disposed in the setting section 111 in astate in which the light projecting section 170 is inclinedapproximately 45° with respect to the optical axis A1 of the objectivelens 131 a such that a reflection surface of the mirror 171 facesobliquely upward. Consequently, the light projecting section 170 isopposed to the lens barrel section 130 across the observation target Sand the stage 121. The light projecting section 170 is opticallyconnected to the light generating section 300 of the processing device200 by a part of the not-shown optical fibers of the fiber unit 201.

The light blocking section 320 of the light generating section 300includes a plurality of opening patterns respectively corresponding tothe regions 140A to 140D of the light projecting section 140 shown inFIGS. 3A and 3B and includes an opening pattern corresponding to thelight projecting section 170. The light-projection control section 510shown in FIG. 2 is capable of making light incident on the lightprojecting section 140 as in the first embodiment by switching theopening pattern of the light blocking section 320 that causes the lightto pass. The light-projection control section 510 is also capable ofmaking the light incident on the light projecting section 170. Behaviorof the light made incident on the light projecting section 140 is thesame as behavior of the light made incident on the light projectingsection 140 in the first embodiment.

The light made incident on the light projecting section 170 is reflectedby the mirror 171 to be emitted upward along the optical axis A1 of theobjective lens 131 a and irradiated on the observation target S on thestage 121. The light emitted from the light projecting section 170 isreferred to as transmission illumination. The light irradiated on theobservation target S is transmitted upward, transmitted through the lensunit 131, and guided to the imaging section 132. By irradiating thetransmission illumination on the observation target S, it is possible toimage the structure on the inside of the observation target S.

The imaging section 132 further generates original image data indicatingthe observation target S at the time when the transmission illuminationis irradiated on the observation target S. The generated original imagedata corresponding to the transmission illumination is stored in thestoring section 420. Imaging information further indicating presence orabsence of execution of irradiation of the transmission illumination andimaging conditions such as a light reception time during the irradiationof the transmission illumination is stored in the storing section 420.

The data generating section 610 shown in FIG. 9 generates image data fordisplay further on the basis of the original image data corresponding tothe transmission illumination in addition to the original image datarespectively corresponding to the ring illumination and the directionalilluminations stored in the storing section 420. Specifically, the datagenerating section 610 combines, at rates decided by illuminationconditions designated by the user, a part or all of the plurality oforiginal image data respectively corresponding to the ring illumination,the directional illuminations, and the transmission illumination. Thegenerated image data for display is stored in the storing section 420.

The measurement head 100 shown in FIG. 34 does not include the lightprojecting section 160 that emits the coaxial epi-illumination. However,the present invention is not limited to this. The measurement head 100shown in FIG. 34 may include the light projecting section 160 same asthe light projecting section 160 shown in FIG. 32. In this case, imagedata for display is generated on the basis of the original image datarespectively corresponding to the ring illumination, the directionalilluminations, the coaxial epi-illumination, and the transmissionillumination.

In the plural illumination imaging processing according to thisembodiment, the observation target S is imaged using the transmissionillumination after the imaging of the observation target S performedusing the ring illumination and the first to fourth directionalilluminations. Consequently, a plurality of (in this example, six)original image data respectively corresponding to the ring illumination,the first to fourth directional illuminations, and the transmissionillumination are generated.

When the plural illumination imaging processing is completed, theobservation screen 430A is displayed on the display section 430. FIG. 35is a diagram showing a display example of the observation screen 430Aafter the plural illumination imaging processing according to the thirdembodiment. As shown in FIG. 35, a transmission button b12 is displayedin the function display region 431 in addition to the plurality ofbuttons b1 to b7 explained above.

The user operates the transmission button b12 using the operationsection 440. Consequently, the user can instruct that image data fordisplay should be generated using the original image data correspondingto the transmission illumination.

When it is instructed that the original image data corresponding to thetransmission illumination is used, a bar 433 e and a slider 433 f fordesignating a combination rate of the original image data correspondingto the transmission illumination to the other original image data(hereinafter referred to as transmission image rate) are displayed inthe sub-display region 433.

The user can designate the transmission image rate by operating theslider 433 f. In the example shown in FIG. 35, the transmission imagerate is designated higher as the slider 433 f is closer to the left endof the bar 433 e. The transmission image rate is designated lower as theslider 433 f is closer to the right end of the bar 433 e.

When the transmission image rate is designated, in the processing instep S209 in FIG. 19 in the image-for-display generation processing, thecontrol section 410 calculates combination rates of the plurality oforiginal image data on the basis of the designated transmission imagerate in addition to the designated emitting direction.

For example, first, the control section 410 calculates combination ratesof original image data respectively corresponding to the ringillumination and the first to fourth directional illuminations on thebasis of the designated emitting direction. Thereafter, the controlsection 410 corrects the combination rates of the original image datarespectively corresponding to the ring illumination and the first tofourth directional illuminations such that a total of a plurality ofcombination rates of the ring illumination and the first to fourthdirectional illuminations is (100-u) % when the designated transmissionimage rate is u (u is a number of 0 to 100)%.

The plurality of original image data are combined on the basis of theplurality of combination rates calculated as explained above, wherebyimage data for display is generated. The image SI of the observationtarget S including components of the original image data correspondingto the transmission illumination is displayed in the main display region432. When the observation target S is formed of a material thattransmits light, the internal structure of the observation target Sclearly appears in the image SI of the original image data correspondingto the transmission illumination.

Therefore, the user can easily acquire the image SI of the observationtarget S corresponding to a purpose of observation by operating thetransmission button b12 and the slider 433 f shown in FIG. 35.

When the measurement head 100 shown in FIG. 34 includes the lightprojecting section 160 shown in FIG. 32 as explained above, in theplural illumination imaging processing, a plurality of original imagedata respectively corresponding to the ring illumination, thedirectional illumination, the coaxial epi-illumination, and thetransmission illumination maybe generated. In this case, on theobservation screen 430A, the epi-illumination button b11, the bar 433 c,and the slider 433 d shown in FIG. 33 and the transmission button b12,the bar 433 e, and the slider 433 f shown in FIG. 35 maybesimultaneously displayed. Consequently, flexibility of adjustment isimproved concerning the image SI of the observation target S displayedin the main display region 432.

[4] Other Embodiments

(1) In the embodiment, after the plurality of original image datarespectively corresponding to the plurality of illuminations aregenerated, the image data for display is generated on the basis of theplurality of original image data according to the illuminationconditions designated by the user. However, the present invention is notlimited to this. The illumination conditions may be designated by theuser first. In this case, original image data necessary for generatingthe image data for display that should be generated is determined on thebasis of the designated illumination conditions.

Therefore, in this embodiment, only illumination corresponding to thenecessary original image data is irradiated on the observation target S.Consequently, only the necessary original image data is generated. Withthis configuration, the other illuminations are not irradiated on theobservation target S. Unnecessary original image data is not generated.Consequently, it is possible to generate the image data for display athigh speed.

(2) In the embodiment, the regions 140A to 140D of the light projectingsection 140 are desirably disposed rotation-symmetrically around theoptical axis A1 of the objective lens 131 a. However, the presentinvention is not limited to this. The regions 140A to 140D of the lightprojecting section 140 do not have to be disposed rotation-symmetricallyaround the optical axis A1 of the objective lens 131 a.

(3) In the embodiment, when the image data for display is generated bycombining the plurality of original image data, one of the plurality oforiginal image data is desirably original image data corresponding tothe ring illumination. However, the present invention is not limited tothis. It is also possible that the original image data corresponding tothe ring illumination is not used for the combination and the image datafor display is generated by combining a part or all of the plurality oforiginal image data respectively corresponding to the directionalilluminations, the coaxial epi-illumination, and the transmissionillumination.

(4) In the embodiment, the image data for display is generated bycombining the plurality of original image data. However, the presentinvention is not limited to this. The image data for display may begenerated by selecting one of the generated plurality of original imagedata. In this configuration, a larger number of original image data aredesirably generated. In this case, it is possible to generate moreaccurate image data for display. Therefore, a larger number of lightemission regions may be provided in order to make it possible togenerate a larger number of original image data. Light emitting membersmay be provided to be capable of emitting lights from a larger number ofpositions. Alternatively, a single light emitting member may be providedto be capable of moving to a plurality of emitting positions.

(5) In the embodiment, the light projecting section 140 has thecylindrical shape. However, the present invention is not limited tothis. The light projecting section 140 may have a shape other than thecylindrical shape. FIG. 36 is a schematic diagram showing a modificationof the projecting section 140. In the example shown in FIG. 36, thelight projecting section 140 has, for example, a hemispherical shape. Aplurality of light sources 142 a are provided to be capable ofirradiating lights in a plurality of emitting directions on anobservation target from any positions on the inner surface of the lightprojecting section 140. In this case, it is easy to generate image datafor display using single original image data without combining aplurality of original image data. In this configuration, it is moredesirable that light amounts of lights in emitting directions can beindividually adjusted.

(6) In the embodiment, in the image-for-display generation processing,when the imaginary emitting direction of light is designated by the useranew, the image SI of the observation target S displayed on the displaysection 430 is switched to the image SI corresponding to the light inthe designated emitting direction. However, the present invention is notlimited to this.

When the imaginary emitting direction of light is designated by the useranew, the image SI of the observation target S based on the image datafor display before the update and the image SI of the observation targetS based on the image data for display after the update may besimultaneously displayed on the display section 430. In this case, theuser can compare the image SI of the observation target S before theemitting direction is designated and the image SI of the observationtarget S after the designation. Therefore, it is possible to easilyidentify an appropriate image SI through the observation of theobservation target S while designating the imaginary emitting directionof light. The example in which the images SI before and after the updateare simultaneously displayed includes, for example, displaying theimages SI before and after the update side by side and superimposing anddisplaying the images SI before and after the update.

[5] Correspondence Relation Between the Constituent Elements of theClaims and the Sections of the Embodiments

An example of correspondence between the constituent elements of theclaims and the sections of the embodiments is explained. However, thepresent invention is not limited to the example explained below.

In the embodiments explained above, the observation target S is anexample of the observation target, the stage 121 is an example of thestage, the objective lens 131 a is an example of the objective lens, andthe lens unit 131 is an example of the lens unit. The optical axes A1and A2 are respectively examples of the optical axes of the objectivelens and the light projecting unit, the light emitting section 140 o isan example of the emitting section, the light projecting section 140 isan example of the light projecting unit, the imaging section 132 is anexample of the imaging section, and the data generating section 610 isan example of the data generating section.

The magnifying observation apparatus 1 is an example of the magnifyingobservation apparatus, the regions 140A to 140D are examples of thelight emission region, the optical fiber 142 is an example of the lightemitting member, the groove 131 b and the protrusion section 141 b arean example of the positioning mechanism, and the lens barrel section 130is an example of the lens barrel section. The inclination sensor 133 isan example of the inclination detecting section, the operation section440 is an example of the first and second operation sections, thedriving control section 500 is an example of the control section, andthe light projecting sections 160 and 170 are respectively examples ofthe first and second light projecting sections.

As the constituent elements of the claims, other various elementsincluding the configurations or the functions described in the claimscan also be used.

The present invention can be effectively used in various magnifyingobservation apparatuses.

What is claimed is:
 1. A magnifying observation apparatus comprising: astage including a placement surface on which an observation target isplaced; a lens unit including an objective lens; a light projecting unitincluding an emitting section having an optical axis substantially sameas an optical axis of the objective lens and provided to surround theoptical axis of the objective lens, the light projecting unitselectively irradiating, on the observation target placed on the stage,light in a first emitting direction and light in a second emittingdirection different from the first emitting direction; an imagingsection configured to receive light from the observation target via theobjective lens and generate first or second original image dataindicating an image of the observation target; and a data generatingsection configured to generate image data for display indicating animage of the observation target that should be obtained when it isassumed that light in a specific emitting direction designated by a useris irradiated on the observation target, wherein at a first lightirradiation time, the light projecting unit irradiates the light in thefirst emitting direction on the observation target and the imagingsection generates the first original image data, at a second lightirradiation time, the light projecting unit irradiates the light in thesecond emitting direction on the observation target and the imagingsection generates the second original image data, and the datagenerating section generates the image data for display on the basis ofat least one of the first and second original image data.
 2. Themagnifying observation apparatus according to claim 1, wherein theemitting section of the light projecting unit includes a plurality oflight emission regions disposed rotation-symmetrically around theoptical axis of the objective lens and simultaneously emits lights fromthe plurality of light emission regions at the first light irradiationtime to thereby irradiate the light in the first emitting direction onthe observation target.
 3. The magnifying observation apparatusaccording to claim 2, wherein, at the second light irradiation time, theemitting section of the light projecting unit emits light from a part ofthe plurality of light emission regions to thereby irradiate the lightin the second emitting direction on the observation target.
 4. Themagnifying observation apparatus according to claim 3, wherein, at thesecond light irradiation time, the emitting section of the lightprojecting unit sequentially emits light from each of the plurality oflight emission regions, and the imaging section sequentially generates aplurality of the second original image data respectively correspondingto the plurality of light emission regions.
 5. The magnifyingobservation apparatus according to claim 2, wherein the plurality oflight emission regions are located on a circumference centering on theoptical axis of the objective lens.
 6. The magnifying observationapparatus according to claim 2, wherein one or more light emittingmembers are provided in each of the plurality of light emission regions.7. The magnifying observation apparatus according to claim 1, whereinthe light projecting unit is detachably attached to the lens unit. 8.The magnifying observation apparatus according to claim 7, wherein apositioning mechanism that determines a position of the light projectingunit with respect to the lens unit is formed in at least one of the lensunit and the light projecting unit.
 9. The magnifying observationapparatus according to claim 1, wherein a lens barrel section isconfigured by the lens unit and the imaging section, and the lens barrelsection is capable of inclining while maintaining a eucentric relationconcerning a predetermined position on the placement surface of thestage.
 10. The magnifying observation apparatus according to claim 9,wherein the lens barrel section further includes an inclinationdetecting section configured to detect an inclination angle of theoptical axis of the objective lens with respect to the normal of theplacement surface of the stage.
 11. The magnifying observation apparatusaccording to claim 2, further comprising: a first operation sectionconfigured to receive an instruction for a start of an observation bythe user; and a control section configured to control, in response tothe instruction received by the first operation section, the lightprojecting unit to sequentially emit the lights in the first and secondemitting directions respectively at the first and second lightirradiation times.
 12. The magnifying observation apparatus according toclaim 11, wherein the control section controls the imaging section toreceive light for a first time period at the first light irradiationtime and controls the imaging section to receive light for a second timeperiod longer than the first time period at the second light irradiationtime.
 13. The magnifying observation apparatus according to claim 1,further comprising a first light projecting section configured toirradiate light in a third emitting direction on the observation targetfrom a position closer to the optical axis of the objective lens thanthe emitting section of the light projecting unit, wherein at a thirdlight irradiation time, the first light projecting section irradiatesthe light in the third emitting direction on the observation target andthe imaging section generates third original image data, and the datagenerating section generates the image data for display further on thebasis of the third original image data.
 14. The magnifying observationapparatus according to claim 1, further comprising a second lightprojecting section disposed to be opposed to the imaging section acrossthe observation target and configured to irradiate light in a fourthemitting direction on the observation target, wherein at a fourth lightirradiation time, the second light projecting section irradiates thelight in the fourth emitting direction on the observation target and theimaging section generates fourth original image data, and the datagenerating section generates the image data for display further on thebasis of the fourth original image data.
 15. The magnifying observationapparatus according to claim 1, wherein the data generating sectiongenerates the image data for display by combining a plurality oforiginal image data including at least one of the first and secondoriginal image data.
 16. The magnifying observation apparatus accordingto claim 15, wherein the data generating section determines rates of thecombination of the plurality of original image data on the basis of thespecific emitting direction.
 17. The magnifying observation apparatusaccording to claim 1, further comprising a second operation sectionoperated by the user in order to designate the specific emittingdirection, wherein the data generating section update, according to thespecific emitting direction designated by the second operation section,the generated image data for display.